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The  Analysis  of  a Practical  and  Nearly  Optimal 
Priority  Queue 

Mark  R.  Brown 

Abstract. 

The  binomial  queue,  a new  data  structure  for  implementing  priority 
queues  that  can  be  efficiently  merged,  was  recently  discovered  by  Jean 
Vuillemin;  we  explore  the  properties  of  this  structure  in  detail.  New 
methods  of  representing  binomial  queues  are  given  which  reduce  the  storage 
overhead  of  the  structure  and  increase  the  efficiency  of  operations  on  it. 
One  of  these  representations  allows  any  element  of  an  unknown  priority 
queue  to  be  deleted  in  log  time,  using  only  two  pointers  per  element  of 
the  queue.  A complete  analysis  of  the  average  time  for  insertion  into 
and  deletion  from  a binomial  queue  is  performed.  This  analysis  is  based 
on  the  result  that  the  distribution  of  keys  in  a random  binomial  queue 
is  also  the  stationary  distribution  obtained  after  repeated  insertions 
and  deletions. 

An  abstract  notion  of  priority  queue  efficiency  is  defined,  based  on 
comparison  counting.  A good  lower  bound  on  the  average  and  worst  case 
number  of  comparisons  is  derived;  several  priority  queue  algorithms  are 
exhibited  which  nearly  attain  the  bound.  It  is  shown  that  one  of  these 
algorithms,  using  binomial  queues,  can  be  characterized  in  a simple  way 
based  on  the  number  and  type  of  comparisons  that  it  requires.  The  proof 
of  this  result  involves  an  interesting  problem  on  trees  for  which 
Huffman's  construction  gives  a solution. 
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Chapter  One.  Priority  Queues 


A priority  queue  is  a structure  for  maintaining  a collection  of 
items,  each  having  an  associated  key,  such  that  the  item  with  the 
smallest  key  is  easily  accessible.  More  precisely,  if  Q is  a priority 
queue  and  x is  an  item  containing  a key  from  a linearly- ordered  set, 
then  the  following  operations  are  defined: 

Insert (x,  Q)  Add  item  x to  the  collection  of  items  in  Q . 

DeleteSmallest(Q)  Remove  the  item  containing  the  smallest  key 

among  all  items  in  Q from  Q ; return  the 
removed  item. 

These  actions  are  referred  to  informally  as  insertion  and  deletion. 

A mergeable  priority  queue  is  a priority  queue  with  the  additional 
property  that  two  disjoint  queues  can  be  combined  quickly  into  a single 
queue.  That  is,  the  operation 

Union (T,  Q)  Remove  all  items  from  T and  add  these  items 

to  Q 

is  defined  when  T and  Q are  mergeable  priority  queues;  this  operation 
is  informally  referred  to  as  merging  T into  Q . Any  pair  of  priority 
queues  can  be  merged  by  using  repeated  applications  of  Insert  and 
DeleteSmallest  , but  we  reserve  the  qualification  "mergeable"  for  those 
priority  queues  which  can  be  merged  quickly:  merging  should  not  require 

examining  a positive  fraction  of  the  items  in  the  queues. 

The  new  results  of  this  thesis,  contained  in  Chapters  2 and  3,  are 
concerned  with  a particular  mergeable  priority  queue,  and  with  priority 
queues  in  general.  Chapter  1 is  an  introduction  to  the  subject  of 
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priority  queues,  and  it  should  provide  background  for  the  later 
chapters. 

The  priority  queue  was  not  recognized  as  a fundamental  data  structure 
until  quite  recently.  Several  nontrivial  priority  queue  organizations 
were  developed  for  different  applications  before  the  usefulness  of  a 
priority  queue  as  an  abstraction  was  pointed  out  by  Knuth  in  1973  [28]. 

It  follows  that  a good  introduction  to  this  subject  requires  not  only  a 
study  of  the  data  structures  and  their  associated  algorithms,  but  also 
an  appreciation  of  the  diverse  applications  in  which  priority  queues 
are  useful.  We  will  devote  Section  1.1  to  a survey  of  these  applications, 
and  describe  the  known  priority  queue  structures  in  Section  1.2. 

Finally,  in  Section  1.3  we  present  a summary  of  the  results  to  be 
proved  in  Chapters  2 and  3. 
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1.1  Priority  Queue  Applications. 

Possibly  the  earliest  application  of  priority  queues  was  in  the 
implementation  of  simulation  programming  languages.  Such  languages  are 
typically  structured  around  an  "event  list"  which  is  a record  of  actions 
to  be  performed  at  given  instants  of  simulated  time  [2;5 >15 ;3°;3^] • 

Thus  adding  a new  action  to  the  event  list  corresponds  to  an  Insert,  and 
executing  the  earliest  event  on  the  list  requires  a DeleteSmallest. 

An  event  list  generally  has  extra  features  which  are  not  part  of 
the  definition  of  a priority  queue.  One  of  these  is  the  FIFO  property: 
events  with  equal  times  must  be  performed  according  to  a FIFO  discipline, 
in  which  the  first  event  entered  into  the  list  is  the  first  to  be  executed. 

In  some  situations  it  is  important  to  be  able  to  remove  an  arbitrary 
event  (not  just  the  earliest)  from  the  list;  in  other  cases,  the  ability 
to  locate  the  event  to  be  executed  immediately  before  or  after  a given 
event  may  be  necessary  [1*1]. 

Another  early  application  of  priority  queues  was  in  sorting  and 
selection  problems.  The  idea  of  selection  sorting  [11;17;28,  Section  5.2.31 
is  to  repeatedly  remove  the  smallest  of  a collection  of  items  and  move 
this  item  to  an  output  area;  hence  we  can  accomplish  a selection  sort 
by  first  filling  a priority  queue  using  successive  Insert  operations, 
and  then  emptying  the  queue  by  using  DeleteSmallest  repeatedly. 

Priority  queues  also  play  a role  in  external  sorting  [28,  Section  5J4.I]. 

Many  external  sorting  methods  use  a technique  called  replacement  selection 
to  form  initial  runs  (sorted  subsequences)  and  to  merge  runs  together; 
replacement  selection  is  based  on  alternating  insertions  and  deletions 
from  a priority  queue.  (Because  the  queue  size  does  not  change  during 
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replacement  selection,  the  full  generality  of  a priority  queue  is  not 
required. ) 

A typical  selection  problem  is  to  find  the  k largest  of  n numbers, 
when  n is  much  larger  than  k . One  solution  to  this  problem  begins  by 
inserting  the  first  k number.,  nto  a priority  queue.  Then  for  as  long 
as  there  are  numbers  which  have  not  been  inserted,  we  insert  a new  number 
into  the  queue  and  then  delete  the  smallest  number  from  the  queue.  When 
this  process  terminates,  the  k largest  numbers  are  contained  in  the  queue 
[28,  exercise  6.1-22],  This  selection  technique  is  used  in  an  algorithm 
for  random  sampling  [27,  algorithm  3.4.2R], 

An  obvious  application  of  priority  queues,  and  one  which  helps 
motivate  their  name,  is  in  job  scheduling  according  to  fixed  priorities. 

In  this  situation  jobs  with  priorities  attached  enter  a system,  and  the 
job  of  highest  priority  is  always  the  next  to  be  executed.  Examples  of 
this  procedure  occur  in  operating  systems  and  in  industrial  practice, 
though  in  both  cases  the  restriction  to  fixed  priorities  may  be  violated 
in  order  to  ensure  fair  scheduling  (that  is,  to  prevent  a low-priority 
job  from  being  delayed  indefinitely). 

Priority  queues  arise  naturally  in  certain  numerical  iterations. 

One  scheme  for  adaptive  quadrature  maintains  a priority  queue  of 
subintervals  whose  union  constitutes  the  interval  of  integration;  each 
subinterval  is  labeled  with  the  estimated  error  committed  in  the  numerical 
integration  over  it.  In  each  step  of  the  iteration,  the  subinterval  with 
the  largest  error  is  removed  from  the  queue  and  bisected.  Then  the 
numerical  integration  is  performed  over  these  two  smaller  subintervals, 
which  are  inserted  into  the  queue.  The  iteration  stops  when  the  total 
estimated  error  is  reduced  below  a prescribed  tolerance.  This  global 


strategy  is  intended  to  result  in  subintervals  over  which  the  errors  are 


roughly  equal  in  magnitude  [33 ] . 

It  has  been  discovered  that  the  use  of  fast  priority  queues  can  improve 
the  efficiency  of  some  well-known  graph  algorithms.  In  Kruskal's  algorithm 
for  computing  minimum  spanning  trees,  the  procedure  of  sorting  all  edges 
and  then  scanning  through  the  sorted  list  can  be  replaced  by  inserting  all 
edges  into  a priority  queue  and  then  successively  deleting  the  smallest 
edge  [2h],  If  the  priority  queue  is  implemented  properly  this  improves 
the  algorithm  on  most  graphs.  Other  ideas,  one  of  which  involves  a good 
mergeable  priority  queue  implementation,  have  led  to  more  improvements 
in  minimum  spanning  tree  algorithms  [3; 19]-  Similar  applications  have 
been  found  for  priority  queues  in  shortest  path  problems  [l8;20]. 

Finally,  there  is  a collection  of  good  algorithms  which  fall  into 
none  of  the  categories  above  but  which  depend  on  priority  queues. 

Chartres'  prime  number  generator  uses  a priority  queue  in  a scheme  to 
reduce  its  internal  storage  requirements  [28,  exercise  5.2.3-15].  B.  L.  Fox 
has  mentioned  that  priority  queues  are  useful  in  implementing  some  discrete 
programming  algorithms  [10],  Huffman's  optimal  code  construction  operates 
on  a priority  queue  in  just  the  opposite  manner  from  the  numerical 
iteration  discussed  above:  it  repeatedly  selects  the  two  smallest 

elements  from  a queue,  combines  them,  and  inserts  the  result  back  into 
the  queue  [26,  pp.  1+02-1*05].  (For  this  problem,  there  is  actually  a 
better  implementation  which  uses  pre- sorting  instead  of  priority  queues. ) 

The  last  of  these  algorithms  that  we  will  mention  is  the  Hu- Tucker 
optimal  binary  search  tree  construction,  whose  asymptotic  running  time 
was  greatly  improved  by  using  a good  implementation  of  mergeable 
priority  queues  [28,  pp.  l+39-^l+] . 
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1.2  Priority  Queue  Structures. 

The  most  obvious  priority  queue  structure  is  certainly  the  linear 
list.  If  we  keep  a priority  queue  as  a list  of  elements  in  arbitrary 
order,  then  an  insertion  consists  of  appending  a new  item  to  the  front 
of  the  list,  and  a deletion  requires  searching  the  entire  list  to  find 
the  smallest  key.  (This  is  a mergeable  priority  queue  since  with 
linked  lists,  two  queues  can  be  merged  in  constant  time. ) A slightly 
more  subtle  method  is  to  keep  the  list  of  elements  sorted  according  to 
their  keys;  then  a deletion  is  performed  by  removing  the  first  item 
from  the  list,  and  an  insertion  requires  searching  down  the  sorted  list 
to  locate  the  proper  place  for  the  new  element. 

The  sorted  linear  list  was  the  structure  first  used  to  implement  event 
lists,  so  it  is  not  surprising  that  this  structure  can  perform  the  extra 
operations  required  for  event  lists,  and  that  it  has  the  FIFO  property. 

Both  of  the  linear  list  schemes  are  easy  to  implement  and  are  quite 
efficient  when  the  queue  size  is  small.  But  both  schemes  have  the 
drawback  that  their  running  time  for  a single  primitive  operation  grows 
linearly  with  the  number  of  entries  in  the  queue.  A deletion  from  an 
unordered  list  always  requires  order  m steps  when  there  are  m items 
in  the  list;  an  insertion  into  a sorted  list  requires  0(m)  time  on  the 
average,  whether  the  list  is  maintained  in  consecutive  storage  locations 
or  in  linked  form.  (Sorted  list  insertion  can  be  made  to  run  faster  if 
the  input  has  a known  FIFO  or  LIFO  tendency. ) So  both  of  these  methods 
are  clow  when  m is  large. 

A new  priority  queue  scheme  was  discovered  in  I96U  by  Arne  Jonassen 
and  Ole- Johan  Dahl  [21].  It  represents  a priority  queue  as  a special 
type  of  binary  tree,  which  they  call  a p.-tree.  Any  node  of  a p-tree  having 
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a null  left  link  must  also  have  a null  right  link,  and  the  keys  in  a 
p-tree  appear  in  increasing  order  when  the  tree  is  traversed  in  postorder. 

By  adding  two  extra  links  to  each  node,  it  is  possible  to  perform. 

a deletion  from  a p-tree  in  constant  time.  Insertion  requires  0(m)  steps 

in  the  worst  case,  but  the  analysis  in  [21]  shows  that  an  average 

2 

insertion  takes  only  O(log  m)  time.  (The  analysis  applies  only  to 
a queue  constructed  by  successive  random  insertions,  but  empirical  tests 
indicate  that  deletions  do  not  significantly  affect  the  cost  of  subsequent 
insertions.)  The  p-tree  structure  has  the  FIFO  property,  and  seems  very 
well  suited  to  event  list  applications. 

In  1961,  J.  W.  J.  Williams  introduced  a data  structure  called  a 
heap  in  connection  with  his  heapsort  algorithm  [28,  pp.  145-1^9]-  The 
heap  structure  uses  a linkless  representation  of  a complete  binary  tree, 
storing  the  root  in  location  1 and  the  offspring  of  the  node  in  location 
k in  locations  2k  and  2k+l  . A heap  is  further  characterized  by  the 
requirement  that  the  key  contained  in  any  node  must  be  no  larger  than  the 
keys  of  its  offspring;  a tree  with  this  property  is  said  to  be  heap-ordered. 

It  is  easy  to  see  that  in  any  heap-ordered  tree,  the  smallest  key  appears 
in  the  root.  Deletion  from  a heap  requires  O(log  m)  time  on  the  average, 
and  insertion  takes  O(log  m)  steps  in  the  worst  case  but  only  0(1) 
on  the  average  [37].  Robert  W.  Floyd  has  demonstrated  a bottom-up 
method  which  creates  a heap  containing  m elements  in  0(m)  time  [ 9 ] • 

Heaps  are  not  difficult  to  implmnent,  and  they  use  storage  efficiently 
since  no  space  is  needed  for  pointers  within  the  structure.  Items  must  move 
in  order  to  perform  insertions  and  deletions,  so  if  the  items  are  long  it  is 
more  efficient  to  store  pointers  in  the  heap,  instead  of  the  items  themselves. 
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A potential  drawback  of  heaps  is  that  they  require  a sufficiently  large 
block  of  contiguous  storage  to  be  allocated  in  advance.  It  is  possible 
to  represent  heaps  as  linked  binary  trees,  with  an  upward  pointer  in 
each  node,  but  this  loses  much  of  the  simplicity  of  the  method. 

A sorted  list  becomes  a practical  priority  queue  structure 
for  large  N , given  an  efficient  way  of  performing  insertions  into  such 
a list.  The  balanced  tree  structure  of  Adel' son-Velskii and  Landis  leads 
to  such  an  efficient  sorted  list  representation,  as  described  in  [k;2&, 
pp.  1*63 -M>8].  Both  insertion  and  deletion  can  be  performed  in  O(log  m) 
steps.  The  algorithms  are  unfortunately  quite  complicated,  but  they 
should  be  useful  in  large  problems  when  all  of  the  flexibility  that 
balanced  trees  offer  is  needed.  An  analogous  sorted  list  representation 
is  possible  with  2-3  trees  [1,  pp.  155-157]. 

The  leftist  tree,  a merge able  priority  queue  structure  based  on 
binary  trees,  was  discovered  in  1971  by  Clark  A.  Crane  [4;  28,  pp.  150-152], 

A leftist  tree  is  heap-ordered,  and  satisfies  the  further  condition  that 
the  shortest  path  from  any  node  to  a leaf  may  always  be  found  by  following 
right-links.  This  explains  the  designation  "leftist",  since  these  trees 
are  generally  slanted  toward  the  left. 

The  basic  operation  on  leftist  trees  is  merging.  It  is  possible  to  merge 
two  leftist  trees  with  a total  of  m nodes  in  0(log  m)  steps;  to  maintain 
the  leftist  structure  during  the  merge  it  is  necessary  to  keep  an  extra 
field  in  each  node  which  records  its  minimum  distance  from  a leaf. 

An  insertion  is  accomplished  by  merging  a single  node  into  the  tree; 
deletion  is  performed  by  removing  the  root  and  merging  its  two  offspring. 

Thus  individual  insertions  and  deletions  take  0(log  m)  steps,  and 
insertions  and  deletions  take  constant  time  in  the  case  that  insertions 
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obey  a stack  discipline.  The  leftist  tree  operations  are  not  difficult 
to  program,  but  since  they  require  more  time  and  space  than  correspondin.;- 
heap  operations  it  seems  that  leftist  trees  are  only  candidates  for 
applications  where  fast  merging  is  required. 

Another  mergeable  priority  queue  was  proposed  in  197 4 by  Aho, 

Hopcroft,  and  Ullman  [1,  pp.  152-155].  The  queue  is  based  on  2-3 
trees,  a close  relative  of  balanced  trees.  A 2-3  tree  is  a tree  in 
which  each  non-leaf  vertex  has  2 or  3 sons,  and  all  leaves  appear 
on  the  same  level.  For  the  mergeable  priority  queue,  assign  items  to 
the  leaves  of  the  2-3  tree,  and  assign  a label  to  each  internal  node 
v which  gives  the  value  of  the  smallest  key  contained  in  the  leaves  of 
the  subtree  rooted  at  v . 

With  this  structure  it  is  possible  to  perform  insertions,  deletions, 
and  merges  in  O(log  n)  steps.  The  algorithms  are  only  described 
informally  in  [ 1 ],  and  are  rather  involved  although  not  difficult  to 
follow.  Although  no  careful  study  has  been  performed,  it  seems  likely 
that  this  priority  queue  is  harder  to  implement,  requires  more  storage 
(because  no  items  are  stored  in  the  internal  nodes),  and  runs  more 
slowly  than  leftist  trees.  The  main  reason  for  interest  in  this  structure 
is  that  it  supports  a claim  that  anything  is  possible  with  2-3  trees. 

The  binomial  queue,  a data  structure  for  implementing  mergeable  priority 
queues,  was  discovered  in  1975  by  Jean  Vuillemin  [42] . The  structure 
is  a special  type  of  forest,  each  of  whose  trees  is  heap-ordered;  this 
forest  can  be  represented  as  a binary  tree.  Chapter  2 considers  this 
structure  in  detail,  and  concludes  that  binomial  queues  are  ] referable 
to  leftist  trees  in  most  applications  of  mergeable  jriority  queues.  They 
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are  also  useful  in  other  priority  queue  applications,  particularly  if 


the  capability  of  deleting  an  arbitrary  item  from  the  queue  is  necessary. 

If  we  assume  that  the  keys  in  our  queue  are  a subset  of  {1,2,..., ml  , 
then  some  interesting  specialized  priority  queue  structures  are  possible, 

A heap-like  structure  due  to  Luther  C.  Abel  [28,  p.  1531  represents  such 
a queue  using  only  2m-l  bits  of  memory;  it  requires  O(log  m)  steps 
for  insertion  and  deletion,  regardless  of  how  many  items  are  in  the  queue. 
A tree  structure  discovered  by  P.  van  Emde  Boas  [kO]  allows  insertions  and 
deletions  in  O(log  log  m)  steps,  but  the  crossover  point  between  this 
structure  and  the  more  straightforward  O(log  m)  methods  has  not  been 
determined. 


1.^  Nummary  of  the  Results. 

The  ] revious  section  presented,  a maze  of  structures  for  implementing 
priority  queues;  how  can  we  choose  among  them?  It  is  not  always  j oesible 
to  base  such  a choice  on  nicely  quantifiable  factors,  since  programming 
time  and  the  number  of  times  a program  is  to  be  used  may  weigh  heavily 
in  the  consideration.  The  peculiarities  of  particular  algorithms  may 
turn  out  to  be  significant  advantages  or  disadvantages  in  a given 
situation:  the  good  performance  of  leftist  trees  when  insertions 

follow  a stack  discipline  may  be  essential  to  solve  some  problem  efficiently, 
or  the  sequential  allocation  required  by  heaps  may  be  impossible 
within  a certain  programming  system.  We  have  attempted  to  convey  a 
feeling  for  these  factors  in  the  discussion  of  the  preceding  section. 

In  spite  of  these  difficulties,  it  turns  out  that  in  many  cases  our 
choice  of  structures  should  be  based  on  quantities  such  as  how  fast  a given 
implementation  will  run,  and  how  much  storage  it  will  use.  The  storage 
requirement  is  usually  obvious,  but  the  running  time,  especially 
"typical"  running  time,  is  generally  more  difficult  to  predict.  It  is 
possible  to  gain  some  feeling  about  the  running  time  by  executing  the 
program  several  times  on  "random"  inputs,  but  this  procedure  is  unsatisfactory; 
it  cannot  give  any  significant  increase  in  our  understanding  of  the  algorithm 
being  tested.  A method  which  can  give  us  more  insight  is  to  determine  the 
expected  running  time  mathematically,  under  some  plausible  definition  of 
what  is  meant  by  "random"  inputs  to  our  algorithm.  This  approach  is 
called  the  analysis  of  an  algorithm  [26,  Section  1.2.10], 

Ideally,  then,  the  following  chapter  should  contain  analyses  of  all 
of  the  algorithms  mentioned  in  the  previous  section.  But  analysis  turns 
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out  to  be  very  difficult  for  complicated  priority  queue  structure. 


One  reason  for  this  is  that  the  structures  tend  to  degenerate  from 


their  "random"  state  (the  state  brought  about  by  consecutive  random 


insertions)  when  they  are  formed  by  a sequence  of  insertions  and 


deletions.  Such  deletion  sensiti'  ity  tends  to  complicate  the  analysi 


[23]*  (Analyses  of  p-trees  [21]  and  heaps  [28;37l  have  been  performed 


Chapter  2 considers  one  priority  queue  structure,  the  binomial 


queue,  in  detail.  When  this  structure  was  introduced  by  Vuillemin  [1*2], 


it  seemed  to  be  of  interest  primarily  due  to  its  intrinsic  beauty  and 


simplicity.  We  show  that  the  beauty  of  this  structure  is  much  deeper 


han  was  previously  appreciated,  by  proving  that  a random  binomial  queue 


remains  random  even  when  deletions  occur.  This  result  allows  us  to 


erform  a complete  analysis  of  binomial  queues 


We  also  demonstrate  in  Chapter  2 that  the  binomial  queue  is  of 


greater  practical  importance  than  was  previously  acknowledged.  We  start 


by  giving  new  methods  for  implementing  binomial  queues  which  improve  the 


speed  and  reduce  the  storage  requirements  of  the  structure;  one  method 


allows  any  element  of  an  unknown  priority  queue  containing  m element 


to  be  deleted  in  O(log  m)  time,  using  only  two  pointers  per  element  of 


the  queue.  We  then  compare  the  running  time  of  a good  implementation  of 


binomial  queues  with  the  time  used  by  other  mergeable  priority  queues,  and 


ee  that  binomial  queues  are  superior  in  most  applications.  Thi 


comparison  is  aided  by  our  analysis  of  binomial  queues,  which  allows  the 


binomial  queue  implementation  to  be  tuned  for  the  best  performance 


There  are  enough  good  priority  queue  structures  in  existence  to 


make  one  wonder  how  fast  any  priority  queue  scheme  can  run.  In  general 
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it  seems  impossibly  difficult  to  prove  results  about  the  minimum  number 


f i 


of  instructions  that  must  be  executed,  or  memory  references  performed, 
in  order  to  accomplish  a given  task.  But  interesting  optimality  results 
have  been  proved  about  sorting,  selection,  and  other  problems  within  more 
restricted  models  of  computation  [28,  Section  5 -3 ] . This  sort  of 
investigation  generally  comes  under  the  heading  of  "computational 
complexity" . 

Chapter  3 is  concerned  with  optimality  results  about  priority  queues, 
a subject  which  has  never  previously  been  addressed.  We  define  the 
efficiency  of  a priority  queue  scheme  in  terms  of  the  number  of  inter-key 
comparisons  it  requires,  and  prove  good  upper  and  lower  bounds  on 
priority  queue  efficiency  within  this  model.  We  also  show  that  a 
certain  form  of  the  binomial  queue  algorithm,  which  is  close  to  being 
optimal  in  our  model,  can  be  characterized  in  a simple  way  in  terms  of 
the  number  and  type  of  comparisons  it  requires. 

The  Appendix  contains  implementations  of  the  binomial  queue 
algorithms  in  a high-level  language.  It  adso  contains  some  of  the 
assembly  language  implementations  used  to  make  the  performance 
comparisons  in  Chapter  2. 


Chapter  Two.  Implementation  and  Analysis  of 
Pinomial  Queue  Algorithms 

The  principal  results  of  this  chapter  were  summarized  briefly  in  the 
previous  section.  In  Section  2.1  we  define  the  binomial  queue  structure 
in  rather  abstract  terms,  and  in  Section  2.2  we  give  informal  descriptions 
of  algorithms  operating  on  this  structure.  No  references  to  binomial 
queue  implementations  are  made  in  these  two  sections;  to  a large  degree, 
the  conceptual  simplicity  of  binomial  queues  depends  on  our  ability  to 
think  of  them  in  this  abstract  manner. 

Section  2.3  presents  several  structures  which  can  be  used  to  implement 
binomial  queues.  While  the  original  structure  proposed  for  this  purpose 
was  a binary  tree,  none  of  our  new  structures  are;  several  advantages  are 
gained  from  abandoning  the  standard  representation. 

In  Section  2.1  we  define  the  notion  of  a random  binomial  queue,  and 
prove  that  randomness  is  preserved  in  a wide  variety  of  situations.  Our 
analysis  of  binomial  queue  algorithms,  based  on  these  insensitivity 
results,  is  contained  in  Section  2.5;  the  end  of  that  section  contains  a 
comparison  of  mergeable  priority  queue  methods. 

In  what  follows  we  use  the  terminology  for  trees  given  in  [26]; 
in  particular,  the  offspring  of  any  node  in  a tree  are  ordered,  while 
in  an  oriented  tree  they  are  unordered. 
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2.1  Binomial  Trees,  Forests  and  Queues 


For  each  k > 0 we  define  a class  of  ordered  trees  as  follows: 

Any  tree  consisting  of  a single  node  is  a BQ  tree.  (1) 

Suppose  that  Y and  Z are  disjoint  B^  ^ trees  for  (2) 

k > 1 . Then  the  tree  obtained  by  adding  an  edge  to  make  the 
root  of  Y become  the  leftmost  offspring  of  the  root  of  Z 
is  a tree. 

A binomial  tree  is  a tree  which  is  in  class  B,  for  some  k ; the 
integer  k is  called  the  index  of  such  a binomial  tree.  Binomial  trees 
have  appeared  several  times  in  the  computer  literature : they  arise 

implicitly  in  backtrack  algorithms  for  generating  combinations  [32]; 

Bq  through  B^  trees  are  shown  explicitly  in  an  algorithm  for  prime 
inrplicant  determination  [36];  a B^  tree  is  given  as  the  frontispiece 
for  [26];  and  oriented  binomial  trees,  called  Sn  trees,  were  used  by 
Fischer  in  an  analysis  of  set  union  algorithms  [81. 

It  should  be  clear  from  the  definition  above  that  all  binomial  trees 
having  a given  index  are  isomorphic  in  the  sense  that  they  have  the  same 
shape.  Figure  1 on  page  19  illustrates  rule  (2)  for  building  binomial 
trees,  and  Figure  2 displays  the  first  few  cases. 

An  alternative  construction  rule,  equivalent  to  (2),  is  often 
useful: 

Suppose  that  Z^  ...,Zq  are  disjoint  trees  such  that  (3) 

is  a B^  tree  for  0 < l < k-1  . Let  R be  a node  which  is 
disjoint  from  each  Zf  . Then  the  tree  obtained  by  taking  R 
as  the  root  and  making  the  roots  of  ...,ZQ  the  offspring 

of  R , left  to  right  in  this  order,  is  a tree. 
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Figure  3 illustrates  rule  (3)  for  building  binomial  trees.  The 
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equivalence  of  (2)  and  (3)  follows  by  induction  on  k . 

For  future  reference  we  record  some  properties  of  binomial  trees, 
including  the  property  which  originally  motivated  their  name: 


Lemma  1. 

Let  Z 

be 

a B^  tree. 

Then 

(i) 

Z has 

2k 

nodes ; 

(ii) 

Z has 

0 

( ^ nodes  on 

level 

Proof.  Trivial,  induction  on  k . u 

For  each  m > 0 we  define  a binomial  forest  of  size  m to  be  an 
ordered  forest  of  binomial  trees  with  the  properties: 

The  forest  contains  m nodes.  (1) 

If  a tree  Y is  to  the  left  of  a tree  Z in  the  (5) 

forest,  then  k > i . (That  is,  the  indices  of  trees  in  the 
forest  are  strictly  decreasing  from  left  to  right.) 

Since  by  (5)  the  indices  of  all  trees  in  the  forest  are  distinct, 
the  structure  of  a binomial  forest  of  size  m can  be  encoded  in  a bit 
string  b^b^_^...bg  such  that  bj  is  the  number  (zero  or  one)  of 
trees  in  the  forest.  By  Lemma  1,  the  number  of  nodes  in  the  forest  is 

Tj  b.*2J  ; hence  b b . . . bn  is  just  the  binary  representation  of  m . 
j > 0 J 1 l-x  v 

This  shows  that  a binomial  forest  of  size  m exists  for  each  m > 0 , 
and  that  all  binomial  forests  of  a given  size  are  isomorphic.  Figure  k 
shows  some  small  binomial  forests. 
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Lemma  2 


Let  F be  a binomial  forest  of  size  m > 0 . Then 
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(i)  The  largest  tree  in  F is  a B,  , tree: 

l_lg  mj 

(ii)  There  are  v(m)  = (#  of  1 ' s in  binary  representation  of  m ) 
trees  in  F ; this  is  at  most  (_lg(nn-l)j  trees; 

(iii)  There  are  m-v(m)  edges  in  F . 

Proof.  Obvious.  □ 

Consider  a binomial  forest  of  size  m such  that  each  node  has  an 

associated  key,  where  a linear  order  ^ is  defined  on  the  set  of  possible 

key  values.  This  forest  is  a binomial  queue  of  size  m if  each  binomial 
tree  of  the  forest  is  heap-ordered;  no  offspring  has  a smaller  key  than 
its  parent.  This  implies  that  no  node  in  a tree  has  a smaller  key  than 
the  root.  Figure  5 gives  an  example  of  a binomial  queue. 

To  avoid  dwelling  on  details  at  this  point,  we  shall  defer  discussion  of 
representations  for  binomial  queues  until  later  sections.  The  timing 
bounds  we  give  here  and  in  the  next  section  can  only  be  fully  justified 
by  reference  to  a specific  representation,  but  the  bounds  should  be 
plausible  as  they  stand. 

The  following  propositions  relating  to  binomial  queues  are  essential: 

Lemma  3.  Two  heap-ordered  trees  can  be  merged  into  a single 

heap-ordered  B^+p  "tree  in  constant  time. 

proof.  We  use  construction  rule  (2).  The  merge  is  accomplished  by 
first  comparing  the  keys  of  the  two  roots,  then  adding  an  edge  to  make 
the  larger  root  become  the  leftmost  son  of  the  smaller.  ('Ties  can  be 
broken  in  an  arbitrary  way. ) This  process  requires  making  a single 
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comparison  and  adding  a single  edge  to  a tree;  for  an  appropriate  tree 
representation  this  requires  constant  time.  □ 

Lemma  b.  Let  T be  a heap-ordered  tree.  Then  the  forest 

consisting  of  subtrees  of  T whose  roots  are  the  offspring  of  the  root 
of  T is  a binomial  queue  of  size  2 -1  . 

Proof.  This  follows  immedi  tely  from  construction  rule  (5)  and  the 
fact  that  subtrees  of  a heap -ordered  tree  are  heap-ordered.  □ 
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Figure  1 


Construction  of  a binomial  tree 
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Figure  2.  Small  binomial  trees. 
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2.2  Binomial  Qqeue  Algorithms. 

In  order  to  implement  a mergeable  priority  queue  using  binomial 
queues,  we  must  give  binomial  queue  algorithms  for  the  operations 
Insert  , DeleteSmal^est  and  Union  which  were  introduced  in  Chapter  1. 

In  the  following  informal  description  of  the  algorithms  we  let  l(Q|| 
denote  the  number  of  elements  in  a queue  Q . 

Consider  first  the  operation  Union (T,  Q)  , which  merges  the  elements 

of  T into  Q,  . If  ||T||  = t and  jiQjj  = q , then  the  process  of  merging 

the  binomial  queues  for  T and  Q is  analogous  to  the  process  of  adding 

t and  q in  binary.  We  successively  "add"  pairs  of  heap-ordered  B, 

K 

trees,  as  described  in  Lemma  3,  for  increasing  values  of  k . In  the 
initial  step  there  are  at  most  two  Bq  trees  present,  one  from  each  queue. 
If  two  are  present,  merge  (add)  them  to  produce  a single  tree,  the 

carry.  In  the  general  step,  there  are  at  most  three  trees  present: 

one  from  each  queue  and  a carry.  If  two  or  more  are  present  we  add  two 
of  them  and  carry  the  result,  a B^+-^  tree.  Each  step  of  this  procedure 
requires  constant  time,  and  by  Lemma  2 there  are  at  most 
max(|_lg(  t+1)  j , |_lg(  !+1)  J ) steps.  Hence  the  entire  operation  requires 
0(max(logj[T||  , log||Q||))  time.  Figure  6 gives  an  example  of  Union  with 
binomial  queues. 

Given  the  ability  to  perform  Union  , the  operation  Insert (x,  Q)  , 
which  adds  item  x to  queue  Q , is  trivial  to  specify:  just  let  X 

be  the  binomial  queue  containing  only  the  item  x , and  perform  Union(X,  Q)  . 
By  this  method,  the  time  required  for  an  insertion  into  Q is  O(log  ||q||)  . 

The  operation  DeleteSmallest(Q)  is  a bit  more  complicated.  The 
first  step  is  to  locate  the  node  x containing  the  smallest  key.  Since 
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X 


is  the  root  or  one  or  the  queue's  trees,  it  can  he  found 

by  examining  each  of  these  roots  once.  By  Lemma  2 this  requires 
O(log  j(Q(|)  time. 

The  second  step  of  a deletion  begins  by  removing  the  heap-ordered 
tree  T containing  x from  the  binomial  queue  representing  Q . 

Then  T is  partially  dismantled  by  deleting  all  edges  leaving  the  root  x 

* lr 

tills  results  in  a binomial  queue  T'  of  size  2 -1  , as  suggested  by 
Lemma  l,  plus  the  node  x which  will  be  returned  as  the  value  of 
DeleteSmallest  . 

The  final  step  consists  of  merging  the  two  queues  formed  in  the 
second  step:  the  queue  T'  formed  from  T , and  the  queue  Q1  formed 
by  removing  T from  Q . Since  each  queue  is  smaller  than  j|Q||  , the 
operation  Urion(T',Q’ ) requires  O(log  ||q||)  time;  therefore  the  entire 
deletion  requires  O(log  ||q||)  time.  Figure  7 gives  an  example  of 
DeleteSmallest  with  binomial  queues. 

In  some  situations  it  is  useful  to  be  able  to  delete  an  arbitrary 
element  of  a priority  queue,  not  just  the  smallest.  It  is  possible  to 
accomplish  this  with  binomial  queues  by  generalizing  the  tree-dismantling 
step  of  DeleteSmallest  . Suppose  x is  the  node  to  be  deleted, 
where  x is  contained  in  the  BR  tree  T . Referring  back  to  Figure  1, 
we  can  decompose  T into  two  Bk_1  trees  Y and  Z . Now  x lies  in 
either  Y or  Z , and  it  lies  in  Y if  and  only  if  the  root  of  Y is 
on  the  path  from  x to  the  root  of  T . So  we  remove  the  edge  joining  Y 
and  Z , save  the  tree  which  does  not  contain  x , and  repeat  the  process 
on  the  tree  containing  x until  x stands  alone  as  a BQ  tree.  When 
the  process  terminates,  k subtrees  have  been  saved,  and  they  constitute  a 
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binomial  queue  of  size  2 -1  . (Note  that  when  x is  the  root  of  T , 
this  procedure  just  deletes  all  edges  leaving  x . ) The  deletion  is 
completed  with  a final  Union  , as  before;  the  same  time  estimates  also 
apply  as  long  as  we  can  delete  each  edge  in  constant  time  during  the 
tree-dismantling  step. 

It  is  interesting  to  note  that  the  time  bound  given  for  the  Insert 
operation  can  be  substantially  improved  if  we  study  the  effect  of 
several  consecutive  instructions.  Consider  the  sequence  of  instructions 

Insert (x^,  Q) ; Insert (x^,  Q) ;.. . ; Insert (x^,  Q)  . 

The  time  for  each  insertion  is  just  0(1)  + 0(nureber  of  edges  created 
by  the  insertion)  . If  j|Q|j  = m initially,  the  number  of  edges  created 
by  this  sequence  of  instructions  is  (rrH-k  - v(m+k)  - (m  - v(m) ) = 
k+v(m)  - v(m+k)  by  Lemma  2.  Hence  the  time  for  k insertions  into  a 
queu  is  0(k)  + 0(k+  v(m)  - v(m+k))  = 0(k+  log  m)  if  the  queue  has 
size  : initially. 

.*  : mentioned  in  Section  1.2,  leftist  trees  and  2-3  trees  can  be 
used  to  implement  mergeable  priority  queues.  The  time  bounds  for  Insert  , 
DeleteSmallect  and  Union  using  these  structures  have  the  same  order  of 
magnitude  as  those  given  above  for  binomial  queues.  But  for  both  of  these 
structures,  insertions  must  be  hanoled  in  a special  way  in  order  to  achieve 
the  O(k+log  m)  time  bound  for  a sequence  of  Insert  instructions.  The 
naive  approach,  that  of  inserting  elements  individually  into  the  leftist 
or  2-3  tree,  can  cost  about  log(k+m)  per  insertion  for  a total  cost  of 
0(k  log(k+m))  . The  faster  approach  is  to  buffer  the  insertions  by 
maintaining  the  newly  inserted  elements  as  a forest  of  trees  with  graduated 
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sizes,  such  as  powers  or  two.  Then  insertions  can  be  handled  by 
balanced  merges,  just  as  with  binomial  queues.  Individual  merge: 

require  more  than  constant  time,  but  the  time  for  k insertions 
comes  to  0(k  + log  m)  . 
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(a)  Binomial  queue  of  size  6 . Node  1 is  to  be  deleted. 


1.5  Structures  for  Binomial  Queues. 


In  implementing  binomial  queues  our  objectives  are  to  make  the 
operations  described  in  the  previous  section  as  efficient  as  possible 
while  requiring  a minimum  of  storage  for  each  node.  As  usual,  the  most 
appropriate  structure  may  depend  on  which  operations  are  to  be  performed 
most  frequently. 

Since  a binomial  queue  is  a forest,  it  is  natural  to  represent  it 
as  a binary  tree  [26],  But  not  all  orientations  of  the  binary  tree  links 
allow  binomial  queue  operations  to  be  performed  efficiently.  Evidently 
the  individual  trees  of  the  binomial  forest  must  be  linked  together 
from  smaller  to  larger,  in  order  to  allow  "carries"  to  propagate  during 
the  Union  operation.  But  in  order  to  allow  two  heap-ordered  binomial 
trees  to  be  merged  in  constant  time,  it  seems  necessary  that  the  root 
of  a binomial  tree  contain  a pointer  to  its  leftmost  child;  hence  the 
subtrees  must  be  linked  from  larger  to  smaller.  This  structure  for 
binomial  queues  was  suggested  by  Vuillemin  [^2];  we  shall  call  it 
structure  V . An  example  of  a binomial  queue  and  its  representation 
using  structure  V is  given  in  Figure  8(a). 

The  time  bounds  given  in  the  preceding  section  for  Insert  , 
DeleteSmallest  , and  Union  can  be  met  using  structure  V , provided 
that  the  queue  size  is  available  during  these  operations.  The  queue  size 
is  necessary  in  order  to  determine  efficiently  the  sizes  of  the  trees  in 
the  queue  as  they  are  being  processed.  (The  alternative  is  to  store  in 
each  node  the  size  of  the  tree  of  which  it  is  the  root;  this  will  generally 
be  less  useful  than  keeping  the  queue  size  available,  and  it  will  use  - re 
storage. ) In  what  follows  we  shall  assume  that  the  queue  size  is  available 
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as  part  of  the  queue  header;  the  other  component  of  the  queue  header 


will  be  a pointer  to  the  structure  representing  the  queue. 

One  drawback  of  structure  V for  binomial  queues  is  that  the 
direction  of  the  top-level  links  is  special.  This  means  that  in  this 
representation,  the  subforest  consisting  of  trees  whose  roots  are  offspring 
of  the  root  of  a binomial  tree  is  not  represented  as  a binomial  queue 
(as  would  be  suggested  by  Lemma  b) ; the  top  level  links  are  backwards. 

Structure  R , the  ring  structure  shown  in  Figure  8(b),  eliminates  this 

problem.  In  this  structure  smaller  trees  are  always  linked  to  larger 
ones,  except  that  the  largest  tree  points  to  the  smallest.  Downward 
links  point  to  the  largest  subtrees,  as  before.  It  appears  that 
structure  R is  slightly  inferior  to  structure  V for  insertions,  but 
is  enough  better  for  deletions  to  make  it  preferable  for  most  priority 
queue  applications.  Structure  V has  some  advantages  for  implementing 
the  fast  minimum  spanning  tree  algorithm  [ U ],  since  the  ordering  of 
subtrees  helps  to  limit  stack  growth  in  that  algorithm.  (The  stack  can 

be  stored  in  a linked  fashion  using  the  deleted  nodes,  thereby  removing 

this  objection  to  structure  R . ) 

Neither  of  the  structures  described  so  far  allows  an  arbitrary  node 
to  be  deleted  from  a binomial  queue,  given  only  a pointer  to  the  node. 

It  is  evident  that  in  order  for  this  to  be  possible,  the  structure  must 
contain  upward  pointers  of  some  sort  which  allow  the  path  from  any  node 
to  the  root  of  the  tree  containing  it  to  be  found  quickly.  It  must  also 
be  possible  to  find  the  queue  header,  since  it  will  change  during  a 
deletion. 
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Simply  aiding  a pointer  from  each  node  to  its  parent  node  (to  the 
queue  header  in  case  of  a root)  in  structure  V results  in  a structure 
which  allows  arbitrary  deletions  to  be  performed.  An  example  is  given 
in  Figure  9(a).  Starting  from  any  node  in  this  structure,  it  is  possible 
to  follow  the  upward  links  and  trace  the  path  to  the  root  of  the  binomial 
tree  containing  the  node.  The  upward  link  from  the  root  leads  to  the 
queue  header,  which  we  assume  is  distinguishable  in  some  way  from  a queue 
node.  Once  the  path  to  the  root  is  known,  the  top-down  deletion 
procedure  described  in  the  preceding  section  can  be  applied. 

While  the  top-down  deletion  process  is  easy  to  describe,  a more 
efficient  bottom-up  procedure  would  be  used  in  practice.  It  is  also 
essential  to  understand  the  bottom-up  procedure  in  order  to  comprehend 
how  alternative  structures  can  be  used.  In  the  initial  step  of  the 
bottom-up  procedure  we  save  all  of  the  trees  whose  roots  are  offspring 
of  the  node  to  be  deleted,  and  call  this  node  the  path  node.  In  the 
general  step  the  path  node  was  originally  the  root  of  a B^  tree  within 
the  binomial  tree  being  dismantled;  its  parent  was  the  root  of  a B tree, 

and  we  have  saved  ...,BQ  trees  so  far.  We  first  save  the  B^  tree 

formed  by  the  right  siblings  of  the  path  node,  taking  the  path  node's 
parent  as  a root.  Then  we  save  the  B^-^,  ...,B^  ^ trees  which  are  left 
siblings  of  the  path  node,  and  make  the  parent  of  the  path  node  the  new 
path  node.  When  the  path  node  becomes  the  root,  the  process  terminates. 

The  forest  of  trees  saved  by  this  process  is  the  same  as  that  created  by 
the  top-down  process,  and  the  remaining  steps  of  the  two  algorithms  are 
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Figure  9(b)  shows  a modification  of  structure  R which  allows 
arbitrary  deletions  to  be  performed.  This  structure  keeps  an  upward 
pointer  only  in  the  leftmost  node  among  a group  of  siblings,  and  this 
pointer  indicates  the  right  sibling  of  the  parent  of  nodes  on  this  level. 
Note  that  the  rightmost  sibling  in  any  family  has  n offspring,  so  the 
parent's  right  sibling  always  exists  when  needed.  It  is  not  too  hard  to 
convince  oneself  that  the  bottom-up  deletion  procedure  just  described 
can  be  performed  on  this  structure. 

Figure  9(c)  shows  a method  of  encoding  the  previous  structure  which 
uses  only  two  pointers  per  node.  The  regularity  of  the  binomial  tree 
structure  allows  us  to  recover  the  information  about  which  "child"  pointers 
actually  point  upward,  as  follows;  the  rightmost  node  in  any  of  the 
horizontal  rings  has  no  offspring  (except  perhaps  on  the  top  level  of  the 
forest),  so  its  "child"  pointer  goes  upward.  If  a node  is  an  only  child, 
or  is  the  right  sibling  of  a node  having  an  only  child,  then  it  is  one  of 
these  rightmost  nodes.  A node  is  an  only  child  if  and  only  if  it  is  its 
own  left  sibling,  so  it  is  possible  to  test  efficiently  whether  or  not  a 
"child"  pointer  goes  upward.  The  upward  pointer  convention  in  Figure  9(c) 
is  slightly  irregular  at  the  top  levels;  here  the  decoding  depends  on  our 
ability  to  distinguish  the  queue  header  from  other  nodes. 

Structure  K , another  structure  which  allows  arbitrary  deletions 
using  only  two  pointers  per  node,  is  shown  in  Figure  9(d).  This  structure 
contains  some  null  links,  and  seems  to  require  less  pointer  updating  per 
operation  than  the  structure  in  Figure  9(c).  Note  that  a path  from  an 
arbitrary  node  to  the  queue  header  can  be  found  by  always  following  "left" 
links,  some  of  which  go  upwards.  To  move  to  the  right  on  a given  level 
we  just  follow  the  child  pointer  and  then  the  "left"  pointer. 


(c)  A structure  with  only  two  pointers  per  node. 


(d)  Structure  K . 

figure  9.  Structures  for  binomial  queues  allowing  arbitrary  deletions. 
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2.U  Random  Binomial  Queues. 

We  define  a random  binomial  queue  of  size  m to  be  the  queue  formed 
by  choosing  a random  permutation  of  {1, 2,  . ,.,m]  and  inserting  the 
permutation’s  elements  successively  into  an  initially  empty  binomial 
queue.  (By  a random  permutation  we  mean  a permutation  drawn  from  the 
space  in  which  all  ml  permutations  are  equally  likely.)  Equivalently, 
a random  binomial  queue  of  size  m is  formed  from  a random  binomial 
queue  of  size  m-1  by  choosing  a random  element  x from 
(i,l^-,...,m-i},  inserting  x into  the  queue,  and  renumbering  the 
queue  such  that  the  keys  come  from  [1, 2,  ...,m]  and  the  ordering  among 
nodes  is  preserved. 

This  definition  of  a random  queue  is  simple,  yet  is  not  artificial. 
The  second  statement  of  the  definition,  which  says  that  the  m-th  random 
insertion  falls  with  equal  probability  into  each  of  the  m intervals 
defined  by  keys  in  the  queue,  is  equivalent  to  another  definition  of 
random  insertion  which  arises  from  event  list  applications.  In  these 
situations,  a random  insertion  is  obtained  as  follows:  generate  an 

independent  random  number  X from  the  negative  exponential  distribution, 

_ 

in  which  the  probability  that  X < x is  1-e  . Then  insert  the  number 

X+t  , where  t is  the  key  most  recently  removed  from  the  queue  (0  if 
no  deletions  have  taken  place).  Here  t is  interpreted  as  the  current 
instant  of  simulated  time,  and  X is  a random  "waiting  time"  to  the 
occurrence  of  some  event.  The  fact  that  this  definition  of  a random 
insertion  is  equivalent  to  the  one  we  have  adopted  was  proved  by  Jonassen 
and  Dahl  [22];  it  follows  without  difficulty  from  the  well-known 
"memoryless"  property  of  the  exponential  distribution. 
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Our  goal  in  this  section  is  to  study  the  structure  of  random  binomial 


queues.  The  gross  structure  of  such  a queue  is  already  evident;  we 
observed  earlier  that  all  binomial  forests  of  a given  size  are  isomorphic. 
But  more  information  about  the  distribution  of  keys  in  the  forest  is 
necessary  to  rully  analyze  the  performance  of  binomial  queue  algorithms. 

For  example,  in  order  to  analyze  the  behavior  of  DeleteSmallest  it 
is  necessary  to  determine  the  probability  of  finding  the  smallest  element 
in  the  various  trees  of  the  binomial  queue.  It  is  also  important  to 
determine  whether  or  not  a random  queue  stays  random  after  a DeleteSmallest 
has  been  performed,  since  if  this  is  true  then  the  analysis  of  random  queues 
may  apply  even  in  situations  where  both  insertions  and  deletions  are  used 
to  build  the  queue. 

Our  first  observation  is  that  the  insertion  algorithm  shows  a certain 
indifference  to  the  sizes  of  the  elements  inserted. 

Lemma  5.  Let  p = p^  p0  . . . p^  be  a permutation  of  {1,2,  ...,m]  . Then 

in  the  binomial  queue  obtained  by  inserting  Pq> Pg’ • • * > Pm  successively 

into  an  initially  empty  queue,  the  tree  containing  p.  is  determined  by 

J 

j for  j = 1, 2,  . . ., m . 


proof.  We  proceed  by  induction  on  m . The  result  is  obvious  for 

m = 1 . For  m > 1 , let  l = 2 ^ ^ m-*  be  the  largest  power  of  two 

less  than  or  equal,  to  m . After  the  first  t elements  of  p have 

been  inserted,  the  queue  consists  of  a single  B,  , , tree.  Later 

|_lg  mj 

insertions  have  no  effect  on  this  tree,  since  it  can  only  be  merged  with 
another  tree  of  equal  size.  once  the  first  i elements  of  p must 
fall  into  the  leftmost  tree  of  the  queue.  Furthermore,  since  the 
leftmost  tree  is  not  touched,  the  remaining  m-l  insertions  distribute 


I 


the  last  elements  of  p into  smaller  trees  as  if  the  insertions  were 


into  an  empty  queue.  This  proves  the  result  by  induction. 


A quicker  but  less  suggestive  proof  of  Lemma  5 simply  notes  that 


comparisons  between  keys  in  the  insertion  algorithm  only  affect  the 


relative  placement  of  subtrees  in  the  tree  being  constructed.  Such 


comparisons  never  determine  which  ' ree  is  to  receive  a given  node. 


What  the  given  proof  of  Lemma  5 says  is  that  the  input  permutation 


p can  be  partitioned  into  blocks  whose  sizes  are  distinct  powers  of  two, 


such  that  the  2 elements  of  block  b form  a B,  tree  when  all  m 

K K 


insertions  are  complete.  The  sizes  of  these  blocks  decrease  from  left 


to  right,  just  as  the  sizes  of  trees  in  the  forest  decrease.  (Another 


priority  queue  structure  with  this  sort  of  indifferent  behavior  is  an 


unsorted  linear  list;  -with  the  linear  list,  the  blocks  are  all  of  size 


one. ) 


The  deletion  algorithm  exhibits  a similar  dependence  on  when  the 


deleted  if'  • was  inserted,  and  a similar  indifference  to  key  sizes.  What 


the  following  lemma  states  is  that  if  we  delete  an  element  from  a binomial 


queue,  then  the  resulting  queue  is  the  same  as  we  obtain  by  never  inserting 


the  element  at  all,  but  permuting  the  elements  that  we  do  insert  in  a 


manner  which  depends  only  on  when  the  deleted  element  was  inserted. 


Lemma  6.  Let  p = p^po  . . . p be  a permutation  of  [1, 2,  ...,m}  . 


Then  there  is  a mapping  r = r^  m from  {1, 2,  . . . , rri-1}  onto 


[1,2, . . ., j-l, j+1, . . .,m]  such  that  the  result  of  inserting  p^  p0 


into  an  initially  empty  binomial  queue  and  then  deleting  p.  is  identical 

J 


to  the  result  of  inserting  Pr(p)Pr(2)  •••Pr(m-l)  into  3X1  initially 


empty  binomial  queue. 
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' IV'  We  basically  mimic  the  procedure  lor  deleting  j . and  then  read 

the  mapping  from  the  result.  The  exact  mapping  depends  on  arbitrary 
choices  made  during  the  merging  process  and  would  be  tedious  to  exhibit 
ior  general  j and  m , so  will  give  an  example  of  the  construction 
r m b 10  j j = 5 . First  the  input  is  divided  into  blocks  as 
described  above. 


[00#00000][][00][] 


Then  the  block  containing  j , which  holds  all  elements  of  the  binomial 
tree  T containing  j in  the  queue,  is  further  divided  to  exhibit  the 
subtrees  produced  when  T is  dismantled. 

[(00)  • (0)  (0  0 0 0)  ] [ ] [0  0]  [ ] . 

This  division  clearly  depends  only  on  m and  j . 

Following  the  dismantling  step  is  a merging  step.  One  possible 
strategy  for  this  merge  is  as  follows.  If  the  dismantled  binomial  tree 
T was  the  smallest  tree  in  the  original  queue,  then  no  merging  is 
required.  Otherwise  combine  the  smallest  tree  in  the  original  queue  with 
the  forest  just  obtained  by  dismantling  T . This  produces  a new  tree 
which  has  the  same  size  as  T had,  plus  a forest  of  small  trees;  the 
merge  is  then  complete.  The  same  effect  would  be  created  (in  the  case 
we  are  considering)  by  reinserting  all  nodes  in  the  order 

(0000)(00)[00](  0)  . 

To  see  this,  just  simulate  the  insertion  process  on  this  input.  The 
intermediate  trees  created  during  this  process  correspond  to  trees  involved 
i.n  the  merge.  (Note  that  the  r maj  is  far  from  being  uniquely 
determined. ) □ 


Here  again  we  can  draw  an  analogy  with  the  unsorted  linear  list, 
which  obviously  has  the  behavior  stated  in  the  lemma. 

Armed  with  this  result,  we  can  determine  the  effects  of  various 
types  of  deletions  on  random  binomial  queues. 

Theorem  1.  Let  Q be  a random  binomial  queue  of  size  m . Suppose 

that  p^  , the  k-th  element  inserted  in  the  process  of  building  Q , 
is  deleted  from  Q and  Q,  is  renumbered.  Then  the  resulting  Q is 
a random  binomial  queue  of  size  m-1  . 

Proof.  Consider  the  ml  equally- likely  permutations  used  to  build  Q . 
When  the  k-th  element  of  each  permutation  is  discarded  and  the  permutation 
renumbered,  each  of  the  (m-l)i  possible  permutations  occurs  m times. 

The  same  is  true  if  some  fixed  rearrangement  of  the  permutation  is  made 
just  before  the  renumbering.  Hence  by  Lemma  6 the  mi  queues  obtained 
by  inserting  all  possible  permutations  of  length  m and  then  deleting 
the  k-th  element  (and  renumbering)  are  just  m copies  of  the  (m-1).' 
queues  obtained  by  inserting  all  permutations  of  length  m-1  . □ 

Theorem  2.  Let  Q be  a random  binomial  queue  of  size  m . Suppose 

that  k , the  k-th  smallest  element  inserted  in  the  process  of  building  Q, 
is  deleted  from  Q,  and  Q is  renumbered.  Then  the  resulting  Q,  is  a 
random  binomial  queue  of  size  m-1  . 

Proof.  Consider  the  ml  equally-likely  permutations  used  to  build  Q . 

For  fixed  j , there  are  (m-1);  of  these  permutations  with  p.  = k ; 

J 

if  we  ignore  p.  and  renumber,  we  get  all  (m-1) I possible  permutations 
J 

of  (1, 2, . . .,m-l]  . The  same  is  true  if  sane  fixed  rearrangement  of  the 
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permutation  is  made  before  renumbering.  Hence  by  Lemma  ■ the  (m-l)J 


queues  obtained  by  inserting  all  permutations  of  length  m with  p.  = k 

J 

and  then  deleting  k (and  renumbering)  are  just  the  (m-l)l  queues 
obtained  by  inserting  all  permutations  of  length  m-1  . This  is  true 
for  each  j , so  the  result  follows.  □ 


Corollary  1.  If  a random  element  (or  randomly  placed  element)  of  the 
input  is  deleted  from  a random  binomial  queue  of  size  m , the  result 
is  a random  binomial  queue  of  size  m-1  . 


Proof.  The  two  statements  are  obviously  equivalent;  they  follow 
immediately  from  Theorem  1 or  Theorem  2.  □ 


These  results  are  sufficient  to  show  that  binomial  queues  stay  random 
in  many  situations.  The  most  important  of  these  is  when  a queue  is  formed 
by  a sequence  of  n random  Insert  operations  intermixed  with  m < n 
occurrences  of  DeleteSmallest  , arranged  so  that  a deletion  is  never 
attempted  when  the  queue  is  empty.  Theorem  2 shows  that  a DeleteSmallest 
applied  to  a random  queue  leaves  a random  queue;  a random  Insert  also 
preserves  randomness.  So  under  the  most  reasonable  assumptions  for 
priority  queues,  binomial  queues  can  be  treated  as  random.  This  is  our 
rationale  for  assuming  random  binomial  queues  in  the  analysis  of  the 
next  section. 

A similar  argument  shows  that  random  binomial  queues  result  when 
intermixed  random  deletions  are  performed;  a simple  argument  appealing 
to  Lemma  6 shows  that  intermixed  deletions  by  age  (how  long  an  element 
has  been  in  the  queue)  also  lead  to  random  queues.  These  types  of 
deletions,  especially  deletions  by  age,  are  somewhat  artificial  for  priority 
queues. 


It  is  natural  to  ask  whether  randomness  is  preserved  by  the  merging 


i 
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of  binomial  queues.  Suppose  that  a random  permutation  of  length  m is 
given;  its  first  k elements  are  inserted  into  one  initially  empty 
binomial  queue,  and  the  remaining  m-k  elements  are  inserted  into 
another.  Then  each  of  these  queues  is  a random  binomial  queue,  and  the 
argument  used  to  prove  Lemma  6 shows  that  the  result  of  merging  these 
queues  is  also  random  as  long  as  some  fixed  choice  is  made  about  which 
two  trees  to  "add"  when  three  are  present  during  the  merge.  So  in  this 
sense  merging  does  preserve  randomness. 

Sensitivity  to  deletions  has  been  studied  in  the  context  of  binary 
search  trees  by  Knott  [25].  The  model  used  there  considers  a random 
insertion  to  be  the  insertion  of  a random  real  number  drawn  independently 
from  some  continuous  distribution  (for  example,  uniform  on  the  interval 
[0, 1J  .)  This  definition  is  not  equivalent  to  ours;  Theorem  1 and 
Corollary  1 hold  for  deletions  from  binary  search  trees,  but  this  does 
not  imply  that  a tree  built  using  intermixed  random  deletions  is  random. 

In  fact,  as  Knott  first  noted,  binary  search  trees  are  sensitive  to 
deletions  in  this  model. 

Binomial  queues,  however,  are  not  sensitive  to  deletions  in  the 
search  tree  model.  In  a general  study  of  deletion  insensitivity,  Knuth 
showed  that  Theorem  2 implies. insensitivity  to  random  deletions,  and 
Lemma  6 implies  insensitivity  to  deletions  by  age  in  this  model  [29]. 
Binomial  queues  are  sensitive  to  deletions  by  order  (e.g.,  DeleteSmallest) 
in  this  model,  but  unsorted  linear  lists,  as  well  as  practically  all  other 
algorithms,  are  also  sensitive  to  these  deletions.  So  even  with  this 
alternative  definition  of  a random  insertion,  random  binomial  queues 
tend  to  remain  random  when  deletions  are  present. 


* 
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At  this  point  it  might  seem  that  nothing  can  destroy  a random 
binomial  queued  This  is  not  true;  a deletion  based  on  knowledge  of  the 
structure  of  the  queue  (or  equivalently,  knowledge  of  the  entire  input) 
can  easily  introduce  bias.  For  example,  ran.:  >>•  quean.'  of  .is.e  1.  rare- 
distributed  as  shown: 


2 U 
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pr  = 1/3 


pr  = 1/3 


pr  = 1/3 


If  we  now  delete  the  rightmost  child  of  the  root  and  renumber,  we  get: 


pr  = 1 


This  isn't  random;  random  binomial  queues  of  size  3 have  the  distribution 


pr  = 1/3 


pr  = 1/3 


pr  = 1/3 


Since  the  analysis  of  binomial  queue  algorithms  performed  in  the  next 
section  is  based  on  random  binomial  queues,  we  are  interested  in  the 
distribution  of  keys  in  these  queues.  By  Lemma  the  probability  that 
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a given  element  (e.g.  the  smallest)  of  a random  permutation  lies  in  a 
given  binomial  tree  is  simply  the  probability  that  the  element  lies  in 
a certain  block  of  positions  within  the  permutation.  Thus  the  probability 
that  the  j-th  largest  element  in  a binomial  queue  of  size  m lies  in  a 
Bk  tree  is  just  2 /m  , assuming  that  a tree  is  present  in  a queue 

of  size  m , This  decomposition  of  the  input  into  blocks  reduces  the 
study  of  random  binomial-  queues  to  the  study  of  random  heap-ordered 
binomial  trees  (i.e.,  random  binomial  queues  of  size  2 ). 

As  we  observed  earlier,  the  smallest  key  in  a heap-ordered  binomial, 
tree  must  oe  in  the  root.  The  distribution  of  larger  keys  is  not  so 
highly  constrained.  The  following  result  characterizes  the  distribution 
of  k>  without  explicit  reference  to  the  nj  possible  input  permutations. 


Theorem  3 . Let  a configuration  of  a heap-ordered  tree  be  any 

assignment  of  the  integers  1,2,..., 2 to  the  nodes  of  a tree  such 

that  the  1 ree  is  heap-ordered.  Then  in  a random  heap-ordered  tree 


configurations  are  equally  likely.  (That  is,  there  are 


,(2k)-l 


distinct  input  permutations  which  generate  each  possible 


configuration. 


Proof.  We  proceed  by  induction  on  k . The  result  is  obvious  for  k = 0 


Assume  that  for  k = j there  are  2 


(2J)-1 


permutations  of  [1, 2, ...,2J] 


which  give  size  to  each  possible  c aifiguration. 


Now  consider  any  fixed  configuration  X of  a tree.  This  tree 

can  be  decomposed  into  the  two  B.  trees  Y and  Z , as  shown  in 

J 

Figure  1.  By  the  argument  of  Lemma  5,  any  permutation  giving  rise  to 


configuration  X must  consist  of  two  blocks,  one  producing  Y and  the 

>ther  Z ; these  blocks  may  appear  in  either  order,  since  the  relative 

position  of  Y and  Z is  determined  by  which  tree  contains  the  smallest 

(2^ )-l 

key.  By  the  induction  hypothesis  there  are  2 arrangements  of 

the  keys  in  tree  Y which  give  rise  to  Y , and  similarly  for  Z . I’o 
(2^)-l  (2^)-l 

there  are  2-2  -2  =2  permutations  which  produce  X . 

fince  this  holds  for  any  X , the  result  follows.  _j 

Jn  the  inductive  step  above,  we  can  note  that  the  element  1 is 

equally  likely  to  be  contained  in  the  first  or  the  second  block  of  a 

permutation  producing  X . This  leads  to  an  easy  inductive  proof  of  the 

proposition  that  the  i-th  inserted  element  is  equally  likely  to  fall  into 
k 

each  of  the  2 nodes  of  a random  heap-ordered  tree. 

Unfortunately,  Theorem  3 does  not  help  much  in  determining  the  exact 
i distribution  of  keys  in  a random  binomial  tree.  There  are  fewer 

| configurations  than  permutations,  but  the  number  of  configurations  still 

increases  rapidly  with  k . 
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2.5  Analysis  of  Binomial  Queue  Algorithms. 

We  are  now  prepared  to  analyze  the  performance  of  Insert  and 
DeleteSmallest  , when  implemented  using  binomial  queues;  this  will 
allow  a comparison  with  other  priority  queue  organizations.  The  binomial 
queue  implementation  to  be  analyzed  is  based  on  structure  R , discussed 
in  Section  2.3  and  pictured  on  page  32.  The  priority  queue  structures 
to  be  used  for  comparison  are  the  heap,  leftist  tree,  sorted  linear 
list,  and  unsorted  linear  list. 

For  each  of  the  five  structures,  the  operations  Insert  and 
DeleteSmallest  have  been  carefully  coded  in  FAIL,  a PDP-10  assembly 
language  (the  binomial  queue  and  leftist  tree  implementations  appear  in 
Append: x A.)  By  inspecting  these  programs,  we  can  write  expressions  for 
their  running  time  as  a function  of  how  often  certain  statements  are 
executed.  It  then  remains  to  determine  the  average  values  of  these  factors. 

The  running  times  (in  memory  references  for  instructions  and  data) 
of  the  binomial  queue  operations  are 

Insert  --  1 6 + 19M  + 2E  + 6A 

DeleteSmallest  --  3 8 + 11B  + 6t  + 4N  - 2L  + 4s  + l4u  + 2X 

where 


M is  the  number  of  Merges  required  for  the  insertion; 

E is  the  number  of  exchanges  performed  during  these  merges  in  order 

to  preserve  the  heap-order  property; 

A is  1 if  M=0,  and  0 otherwise; 

B is  1 if  the  queue  contains  no  £ j tree,  and  0 otherwise; 

T is  the  number  of  binomial  trees  in  the  queue; 
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N i s the  number  of  times  that  the  value  o ■ the  smallest  key  seen  so 


r'ar  is  changed  during  the  search  for  the  root  containing  the  smallest 
key; 

L is  1 if  the  smallest  key  is  contained  in  the  leftmost  root,  and  0 
otherwise; 

S is  the  number  of  offspring  of  the  root  containing  the  smallest  key; 

U is  the  number  of  merges  required  for  the  deletion;  and 
X is  the  number  of  exchanges  performed  during  these  merges. 

(To  keep  the  expression  for  DeleteSmallest  simple,  certain  unlikely  paths 

‘ trough  the  program  have  been  ignored.  The  expression  above  always 

ov  rcstimates  the  time  required  for  these  cases.) 

As  a first  step  in  the  analysis  we  note  that  several  of  the  factors 

ab  ve  depend  only  on  the  structure  of  the  binomial  queue  Q and  not  on  the 

distribution  of  keys  in  Q . Since  the  structure  of  Q,  is  determined 

solely  by  its  size,  these  factors  are  easy  to  determine.  For  example,  if 

Q has  size  m then  evidently  M is  the  number  of  low-order  1 bits  in 

the  binary  representation  of  m , and  A = 1 if  and  only  if  m is  even. 

1 early  B = A and  by  Lemma  2 we  can  see  that  T = v(m)  . 

These  factors  are  a bit  unusual  in  that  they  do  not  vary  smoothly 

with  m . For  example,  when  m = 2n-l  we  have  M = T = n , while  for 

n 

m = 2 this  changes  to  M = 0 and  T = 1 . Since  in  practice  we  are 
generally  concerned  not  with  a specific  queue  size  m but  rather  with  a 
range  of  queue  sizes  in  the  neighborhood  of  it  , it  makes  sense  to  average 
th*;  performance  of  our  algorithms  over  such  a neighborhood. 

Factors  A and  M can  be  success  stilly  smoothed  by  this  approach; 
averaging  over  the  interval  [m/2  , 2-  ] gives  an  expected  value  of 


h °( 


for  A and  1+0 


(^) 


for  M . This  agrees  well 


with  our  intuition,  since  it  says  that  about  half  of  the  integers  in 


the  interval  are  even,  and  that  one  carry  is  produced,  on  the  average. 


by  incrementing  a number  in  the  interval. 


Properties  of  the  factor  T = \> (m)  have  been  studied  extensively. 


From  [35]  we  find  that 


ig(!m)J  £ 


1 < k <m 


< ^ i m lg  m J 


where  each  bound  is  tight  for  infinitely  many  m ; it  follows  that  our 


neighborhood  averaging  process  will  not  completely  smooth  the  sequence 


v(m''  . Bus  we  have  bounds  on  an  "integrated"  version  of  v(n)  > so 


differentiating  the  bounds  puts  limits  on  the  average  growth  rate  of 


v(m)  . Carrying  out  the  differentiation  gives 


I C 16  m + ih  - lg  J ) - Tavg.  ± I ( lg  m + 


which  is  about  what  we  expect:  half  of  the  bits  are  1 , on  the  average. 


The  remaining  uncertainty  in  the  constant  term  is  about  .21  . 


While  this  averaging  technique  fails  to  smooth  the  sequence  v(m) 


completely,  there  are  other  methods  which  succeed.  There  is  no  single 


"correct"  method  for  handling  problems  of  this  type:  different  techniques 


may  give  different  answers,  and  the  usefulness  of  a result  depends  on  how 


"natural"  the  smoothing  method  is  in  a given  context.  The  more  powerful 


averaging  techniques  which  succeed  in  smoothing  v(m)  seem  artificial 


in  connection  with  our  analysis,  but  the  results  are  quite  interesting 


mathematically.  Iyle  Ramshaw  [39]  has  shown  that 


L 


using  logarithmic  averaging  [i’J;  hie  result  is  baaed  on  the  detailed 

analysis  of  v(k)  performed  by  Hubert  Delange  [ ].  The 

1 < k _im 

naturalness  of  logarithmic  averaging  is  indicated  by  the  "act  that 
it  also  leads  to  the  logarithmic  distribution  of  leading  digits  which 
has  been  observed  empirically  [38527,  Section  1.2.1],  and  the  fact 
that  it  is  consistent  with  several  other  averaging  methods  (such  as 
rei  eated  Cesaro  summing)  when  those  methods  define  an  average. 

This  analysis  of  factor  T completes  the  purely  "structural" 
analysis ; the  remaining  factors  depend  on  the  distribution  of  keys  in 
the  queue.  For  the  average-case  analysis  we  shall  assume  that  Q is 
a random  binomial  queue  of  size  m and  that  the  insertion  is  random. 

These  assumptions  axe  well  justified  by  the  discussion  of  Section  2.1. 

The  factors  E and  X are  easy  to  dispose  of.  Since  we  only  merge 

trees  of  equal  size,  our  randomness  assumption  says  that  an  exchange  is 
required  on  half  of  the  merges  (on  the  average  . More  precisely,  if 
there  axe  n merges  then  the  number  of  exchanges  is  binomially  distributed 
with  mean  n/2  and  variance  n/1  . The  number  of  merges  is  just  M in 
the  case  of  E , and  U in  the  case  of  X . 

The  factors  L and  S are  also  easy  to  analyze.  We  noted  in 

Section  2.1  that  the  probability  of  having  the  queue's  smallest  key  in 
a given  tree  is  just  proportional  to  the  size  of  the  tree.  Therefore  if 


th<  r<  is  a binomial  tree  of  . L z<  " in  a lueue  of  size  m , this  tree 
• ntains  the  queue's  smallest  key  with  probability  2“/m  . The  root  of 


of  S is  - F(m)  where 
in  x ' 


F(m)  = 


b,  • k»2 
k 


m=(b£b£_r..b0)2 


While  it  seems  hard  to  find  a simpler  closed  form  for  F(m)  , it  is 
possible  to  derive  good  upper  and  lower  bounds. 


Lemma  8.  The  function  F(m)  defined  above  satisfies 
T m lg  m - 2m  1 < F(m)  < |_m  lg  mj  , m > 1 , and  the  upper  bound  is 

tight  for  infinitely  many  values  of  m . 


Proof.  (This  argument  is  similar  to  the  one  used  to  prove  Theorem  1 
in  [25]*)  From  the  definition  of  F(m)  , if  m = 2 then 

F(m)  = F(2k)  = k.2k  = m lg  m . 

It  is  also  clear  from  the  definition  that 

F(2k+i)  = F(2k)  + F(i)  , 0 i < 2k  . 

The  upper  bound  on  F(m)  is  evidently  attained  whenever  m is  a 
power  of  two.  It  therefore  holds  when  m = 1 , and  assuming  that  it 
holds  up  to  m = 2 , we  have 


F(nn-i)  = F(2  ) + F(i) 


(0  < i < 2 ) 


< m lg  m + i lg  i 


< (m+i)  lg(m+i) 


So  the  upper  bound  holds  for  all  m by  induction. 


t.- 


The  lower  bound  on  F(m)  holds  when  ra  = 1 , and  whenever  m in 


a j ower  o:'  two.  Suppose  that  a bound  of  the  form 

F(m)  > m lg  m - c m 

\ y 

is  true  for  some  c > 0 and  all  m _ • Then 

F(nH-i)  = F(2k)  + F(i)  (0  _ i 2k) 

mlgm+ilgi-ci 
It  I'ollows  that  if  the  inequality 

m lg  m + i lg'i  - c i > (m+i)  lg(nH-i)  - c(m+i)  (0  _ i < 2 

• •,  the  lower  bound  will  hold  for  all  m by  induction.  Replacing  i 
xm  and  simplifying  gives  another  inequality  which  implies  the  result: 

x lg  x > U+x)  lg(l+x)  - c (0  < x < 1)  . 

* 

| But  it  is  easy  to  verify  that  x lg  x - (1+x)  lg(l+x)  is  decreasing 

on  [0,1]  , so  we  can  take  x = 1 to  determine  c = 2 . (A  tight  lower 

k k 

I bound  can  be  found  by  using  the  value  F(2  -1)  = (k-2)2  +2  . N -J 


According  to  these  bounds,  the  average  value  of  S lies  between 
lg  m-2  and  lg  m . Lyle  Rajnshaw  [39]  has  shown  that  the  logarithmically 
averaged  value  of  S is 


The  expected  value  of  L is  2^-'Lg  /m  , which  is  between  1/2 
and  1 . 

Factor  U is  closely  related  to  S . The  number  of  merges  required 
is  equal  to  the  number  of  trees  (i.e.,  S ) created  by  removing  the  node 
containing  the  smallest  key,  minus  the  number  of  these  trees  which  are 
not  merged.  Since  the  first  merge  must  take  place  with  the  smallest 
tree  remining  in  the  original  forest,  we  see  that  the  number  of  trees 
excluded  from  merging  is  equal  to  the  number  of  low-order  0 bits  in  . 

Since  the  least  significant  bits  of  m are  distributed  almost  uniformly, 
the  average  value  of  this  quantity  S-U  is  the  same  as  the  average  value 
of  K:  . 

. •'  :•  ..  is  more  interesting.  One  way  to  search  for  the  small  i • 

root  in  the  forest  is  to  use  the  key  contained  in  the  rightmost  root  as 
an  initial  estimate  for  the  smallest  key,  an  i then  :ai  forest  from 

right  left,  updating  the  estimate  as  smaller  keys  are  seen.  Since  the 
trees  increase  in  size  from  right  to  left,  trees  in  the  left  of  the  forest 
are  more  likely  to  contain  the  smallest  key;  thus  the  estimate  of  smallest 
key  will  be  changed  often  during  the  scan.  To  be  more  precise,  the 
expected  number  of  changes  while  searching  a forest  of  size 


Pr( estimate  changes  when  the  p,  tiv  ; examined 

1\ 


V1 


(number  of  nodes  in  t ■ b tree) 


i)sk<n  (total  number  oi'  node,  'n  all 


trees  examined,  0 l . k) 


bk=l 


0 < k < n 2)  2 * 

v,  -i  0<Kk 


b.=l 

k 


b„  = 1 


When  m = 2 -1  this  has  the  simple 


2 4 3 ?n_1 

— — "+*  ■ — +■  i ' 

3 7 15  0n  . 


= ^ + | (a  - 1)  + o(2"n  1 


where  a = 22 


k >1  2-1 


l.<  )6<  ■ . . . 


constant  a also  aris  . in  ■ nnection  with  Heap sort;  see  [23,  5.2.3(19)].) 
A search  strategy  which  intuitively  seems  superior  to  the  one  just 
- t i s to  search  the  forest  fr  1 left  t right;  for  the  at  ve  example 
the  exi ected  number  of  changes  is  reduc-  d to 


1 + 1 + _1_ 

3 7 15 


-1  + 0(2 


•'  this  strategy  is  r t practical;  the  ink  nt  ii  the  wrong  direcl  n. 
With  structure  R we  can  improve  the  search  by  using  the  key  contained  in 


.'l  . . ..  . -x  n.  tiu  v.% 


▼ • 


the  leftmost  root  as  our  initial  estimate  in  a right  to  left  search, 
makes  the  expected  number  of  changes  in  a queue  of  size  2n-l  equal  to 


-n-2 


,n-l 


2n'1+l 


2n~1+2+l 


2n  1+U+2+l 


2n-l 


2n-l 


By  writing  this  sum  in  reverse  order  we  can  derive  its  asymptotic  value: 


where  a’  = £ ~T~ — = 1.26449... 

k > 0 2+1 

(The  constant  ce  arises  in  connection  with  merge  sorting;  see  [28, 
exercise  5*2.4-13] . ) So  the  expected  value  of  this  factor  is  about 
1.13  for  large  n ; by  modifying  the  search  in  this  way  we  have 
effectively  removed  part  of  the  inner  loop. 

This  completes  the  analysis  of  Insert  and  DeleteSmallest  for 
binomial  queues.  By  plugging  our  average  values  into  the  running  4 ime 
expressions  given  above  and  simplifying,  we  get  the  results  for  binomial 
queues  shown  in  Figure  10.  A much  simpler  analysis  [2 C,  pi.  9I-QQ)  give 
the  corresponding  results  for  sorted  and  unsorted  linear  lists  (also 
shown  in  Figure  10. ) 
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1 riority  queue  algorithms  based  on  heaps  and  leftist  trees  have 
i t been  completely  analyzed;  partial  results  are  known  for  heaps 
[ :;3?]  but  not  for  leftist  trees.  Therefore  experiments  were  performed 

to  determine  the  average  values  of  factors  controlling  the  running  time 
of  these  algorithms . Leftist  trees  ana  heaps  are  deletion  sensitive, 
so  the  averages  were  taken  from  stationary  structures  (obtained  after 
• ated  insertions  and  deletions)  rather  than  from  random  structures. 
Figure  10  gives  the  experimentally  determined  running  times  for  leftist 
trees  and  heaps. 

These  results  indicate  that  binomial  queues  completely  dominate 
leftist  trees.  Not  only  do  binomial  queues  require  one  fewer  field  per 
node,  they  also  run  faster,  on  the  average,  for  m > U when  the  measure 
of  performance  is  the  cost  of  an  Insert  followed  by  a Delete  . 

Linear  lists  are  of  course  preferable  to  both  of  these  algorithms  for 
small  m , but  binomial  queues  are  faster  than  unsorted  linear  lists, 
on  the  average,  for  m > 18  at  a cost  of  one  more  pointer  per  node.  So 
the  binomial  queue  is  a very  practical  structure  for  mergeable  priority 
queues. 

In  some  applications  the  queue  size  may  constantly  be  in  a range 
which  causes  the  insertion  and  deletion  operations  on  binomial  queues  to 
run  mere  slowly  than  our  averages  indicate,  due  to  the  smoothed  average 
we  computed.  If  the  queue  size  can  be  anticipated  then  dummy  elements 
added  to  the  queue  might  actually  speed  up  the  algorithms.  At  the  expense 
of  complicating  the  algorithms  it  is  -Uso  possible  to  maintain  a queue  as 
two  binomial  forests  in  such  a way  that  each  insertion  is  guaranteed  to 
take  only  constant  time.  But  the  binomial  queue  algorithms  as  they  stand 
still  dominate  algorithms  using  leftist  trees,  even  if  the  leftist  tree 


operations  have  average-case  running  times  and  the  binomial  queue 
operations  always  take  the  worst-case  time.  The  only  advantages  which 
can  apparently  be  claimed  for  leftist  trees  is  that  they  are  easier  to 
implement  and  can  take  advantage  of  any  tendency  of  insertions  to  follow 
a stack  discipline. 

The  comparison  of  binomial  queues  with  heaps  and  sorted  linear  lists 
is  also  interesting.  The  heap  implementation  stores  pointers  in  the 
heap,  instead  of  the  items  themselves;  this  is  the  usual  approach  when 
the  items  are  large  and  should  not  be  moved.  In  this  situation  heaps 
are  slightly  faster  than  binomial  queues  on  the  average,  and  considerably 
faster  in  the  worst  case.  Heaps  also  save  one  pointer  per  node,  so  it 
seems  that  heaps  are  preferable  to  binomial  queues  when  fast  merging  is 
not  required.  Binomial  queues  have  an  advantage  when  sequential 
allocation  is  a problem,  or  perhaps  when  arbitrary  deletions  must  be 
performed.  Sorted  linear  lists  are  better  than  both  methods  when  m 
is  small,  but  heaps  are  faster,  on  the  average,  when  i.  > 30  . 


average  case  running  times  when  |q|  = m 


queue 

Insert (x,  Q) 

DeleteSmallest ( Q) 

Insert (x,  Q);  DeleteSmallest ( q 

binomial  queue 

39 

22  lg  m + 

19 

22  lg  m + 58 

leftist  tree 

17  lg  m + 39 

35  lg  m - 

27 

52  lg  m + 8 

linear  list 

19 

6m  + 2 lg 

m + 20 

6m  + 2 lg  m + 39 

heap 

32 

18  lg  m + 

1 

18  lg  m + 33 

sorted  list 

3m  + 17 

15 

3m  + 32 

worst  case  running  times  when  j Q j 

= m . 

queue 

Insert (x,  Q) 

DeleteSmallest ( Q) 

Insert (x,  Q);  DeleteSmallest ( Q) 

binomial  queue 

21  lg  m + 16 

30  lg  m + 46 

51  lg  m + 62 

leftist  tree 

32  lg  m + 23 

64  lg  m - 7 

96  lg  m + 16 

linear  list 

19 

9m  + 15 

9m  + 3! 

neap 

12  lg  m + 14 

18  lg  m + 16 

30  lg  m + 30 

sorted  list 

6m  + 20 

15 

6m  + 35 

Figure  10.  Comparison  of  methods. 
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Chapter  Three.  The  Complexity  of  Priority  Queue  Maintenance 


The  inherent  complexity  of  sorting,  selection,  and  related  problems 
has  been  studied  extensively  [28],  The  complexity  of  inserting  and  deleting 
items  from  a priority  queue  has  not  received  such  attention,  possibly 
because  the  individual  operations  take  constant  time  in  certain  cases. 
Priority  queues  may  be  used  to  perform  sorting,  however;  hence  it  is  clear 
that  there  is  some  limit  to  the  average  efficiency  of  a sequence  of  priority 
queue  operations. 

In  Section  3.1  of  this  chapter  we  develop  a definition  of  priority  pao 
efficiency,  based  on  the  average  number  of  comparisons  required  to  execute 
a certain  fixed  pattern  of  insertions  and  deletions.  We  evaluate  some 
known  priority  queue  algorithms  in  Section  3-2  to  obtain  upper  bounds  on 
the  average  and  worst  case  behavior  of  priority  queues.  In  Section  3.3  we 
prove  lower  bounds  on  the  average  and  worst  case  efficiency;  these  bounds 
are  exact  for  infinitely  many  queue  sizes. 

One  of  the  priority  queue  algorithms  discussed  in  Section  3.2,  based 
on  binomial  queues,  has  a simple  characterization  which  is  proved  in 
Section  3.1:  it  is  the  only  algorithm  which  compares  only  "unbeaten" 

nodes  (nodes  which  are  smaller  than  all  nodes  in  the  queue  with  which 
they  have  been  compared)  and  which  takes  a number  of  comparisons  independent 
of  the  key  values  involved.  The  proof  given  for  this  result  uses  a lemma 
involving  two  extremal  problems  on  trees;  we  show  that  Huffman's  constructio; 
[I1  ;26,  pp.  102-405]  solves  these  problems.  This  is  especially  interesting 
since  the  problems  lie  outside  the  large  domain  for  which  Hufi'man  trees 
were  proved  optimal  in  [ 13 ] . 

We  conclude  the  chapter  with  a discussion  of  possible  generalizations 
and  open  problems  in  Section  3*5. 
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•^.1  A Setting  for  Priority  Queue  Complexi ty. 

We  shall  investigate  the  complexity  of  priority  queues  i n ti.  • 
following  context.  initially  we  are  given  a priority  queue  containing 
m elements.  We  then  perform  an  infinite  number  of  cycles  which  consist 
of  first  deleting  the  smallest  element  of  the  queue,  and  then  inserting 
a new  element  into  the  queue.  A typical  cycle  of  this  infinite  process 
is  represented  pictorially  in  Figure  1.  (it  is  easy  to  imagine  other 
settings  in  which  to  study  the  complexity  of  priority  queues,  but  we 
defer  discussion  of  this  topic  until  Section  3.5*) 

Our  measure  of  the  performance  of  a priority  queue  will  be  based  on 
the  number  of  comparisons  made  between  keys  during  the  above  process. 
Therefore  we  restrict  our  attention  to  priority  queue  methods  which  are 
based  entirely  on  the  linear  ordering  among  keys.  This  means,  for  example, 
that  none  of  our  methods  may  perform  arithmetic  on  keys.  We  shall  further 
assume  that  all  keys  are  distinct,  so  that  there  are  only  two  possible 
outcomes  from  any  comparison. 

Note  that  because  we  make  so  few  assumptions  about  what  goes  on  inside 
a priority  queue,  it  is  possible  that  the  number  of  comparisons  used  on 
any  particular  cycle  is  zero.  A deletion  takes  no  comparisons  if  the 
smallest  element  is  known  prior  to  the  deletion,  and  an  insertion  takes 
no  comparisons  if  the  queue  just  stores  the  inserted  node  without  looking 
at  it.  In  order  to  cope  with  this  sort  of  anomaly,  we  use  as  our  measure 
of  cost  the  number  of  comparisons  pjer  cycle  averaged  over  infinitely  many 
cycles.  More  precisely,  if  a method  uses  C(n,m)  comparisons  to  perform 
n cycles  on  a queue  of  size  m , then  its  limit  cost  pjer  cycle  is 

lim  r(n* m } a we  denote  by  Q(m)  the  minimum  limit  cost  per  cycle 
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which  suffices  (in  the  worst  case)  to  maintain  a priority  queue  of  s ' ze  ■ . 
We  define  Q(m)  to  be  the  minimum  average  limit  cost  per  cycle,  where 
insertion  into  each  of  the  m intervals  bounded  by  the  m-1  key  values 
in  the  queue  is  taken  to  be  equally  likely  during  each  cycle. 

Because  we  are  averaging  the  number  of  comparisons  over  many  cycles, 
it  is  possible  to  make  a further  assumption  about  the  internal  structure 
of  our  priority  queues:  we  may  assume  that  at  the  beginning  of  each  cycle 

the  smallest  element  of  the  queue  is  known.  This  is  a valid  assumption 
because  it  just  amounts  to  charging  the  previous  cycle  for  whatever 
comparisons  are  required  at  the  start  of  a cycle  to  determine  the 
smallest.  Since  we  are  averaging  over  infinitely  many  cycles  this  cannot 
change  the  result. 

This  additional  property  allows  us  to  make  a slightly  less  abstract 

interpretation  of  the  situation.  The  state  of  a priority  queue  at  tic- 

beginning  of  a cycle  can  be  represented  as  a directed  acyclic  graph, 

where  the  arcs  indicate  comparisons  which  have  been  made  in  the  ] rocess 

of  maintaining  the  queue.  An  arc  leads  from  a node  with  key  PI  to  a 

node  with  key  K.  if  the  comparison  K.  : K.  was  made  and  K.  K.  was 

J i J i J 

the  result.  Ac  indicated  in  Figure  2,  the  graph  has  a single  source  node, 
containing  the  smallest  key,  at  the  start  of  each  cycle.  Then  this  node 
is  removed  from  a graph,  corresponding  to  deleting  the  smallest  element 
of  the  queue,  and  a new  node  is  added  to  the  graph.  This  node  is  inserted 
into  the  queue  by  performing  enough  convparisons  (adding  directed  arcs)  to 
again  determine  the  smallest  element  (obtain  a graph  having  a single  source). 


(a)  The  start  of  a cycle  (cornpar Isons  to  be  lost  by  deletion  of  smalles 
are  shown  dashed) . 


(b)  After  removal  of  the  smallest  node  and  introduction  of  the  inserted 
node  (5 ) . 


(c)  Insertion  complete  (added  comparisons  are  shown  wavy). 

Figure  2.  Directed  graph  interpretation  of  a priority  queue  cycle. 


3 .2  Upper  Bounds. 

Upper  bound,  on  Q(m)  are  provided  by  the  priority  queue  structures 
described  in  Section  1.2.  Heaps  and  leftist  trees  each  require  about 
2 lg  m comparisons,  in  the  worst  case,  for  a cycle  on  a queue  of  size  m . 
Queues  based  on  balanced  trees  also  require  at  least  c lg  m comparisons 
for  some  constant  c > 1 , in  the  worst  case.  But  some  queue  structures 
reduce  the  coefficient  of  lg  m to  1 . 

One  such  structure  is  the  sorted  linear  list.  The  smallest  element 
of  such  a list  can  be  deleted  using  no  comparisons;  an  insertion  into  a 
list  of  (m-1)  items  requires  at  most  Tig  m"l  comparisons,  using 
binary  search.  It  follows  that  Q(m)  < \ lg  m~l  . More  detailed  analysis 
of  binary  search  [28,  p.  19M  shows  that  the  average  number  of  comparisons 

Q 

required  is  lg  in  +(1  + 9-  2 ) where  9 = f lg  ml  - lg  m ; hence 

g q 

Q(m ) < lg  m + (1+9-2  ) . The  function  (l+e-2  ) is  nonnegative  and 
has  a maximum  value  of  about  0.0861  for  0 in  the  range  0 < 9 < 1 . 

There  is  good  reason  to  feel  uneasy  about  these  bounds,  since  when 
this  priority  queue  is  implemented  using  simple  linked  or  sequential  list 
structures  its  average  running  time  for  a cycle  is  0(m)  . Fortunately 
there  is  a more  legitimate  structure  which  gives  exactly  the  same 
comparison  bounds  as  a sorted  linear  list:  the  "loser-oriented"  tree 

used  for  replacement  selection  [28,  p.  2531*  Using  this  structure,  the 
running  time  for  a cycle  is  proportional  to  the  number  of  comparisons 
performed. 

A third  structure  which  gives  a good  upper  bound  is  a variant  of 


the  binomial  queue.  The  standard  binomial  queue  algorithms  given  in 
Section  2.2  can  require  about  2 lg  m comparisons  for  BeleteSmallest  ; 
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it  may  take  lg  m to  find  the  smallest,  and  lg  m to  merge  its 


\ 
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offspring  back  into  the  forest.  An  Insert  operation  also  requires 
up  to  lg  m comparisons,  so  an  entire  cycle  may  take  about  3 lg  m 
comparisons. 

To  reduce  the  number  of  comparisons  required  by  a binomial  queue 
cycle,  add  nodes  containing  the  key  +00  to  the  queue,  making  the  queue 
size  2 where  k = f lg  ml  . Then  at  the  start  of  a cycle  the  queue 
consists  of  a single  heap-ordered  tree,  and  the  DeleteCmallest 

operation  requires  no  comparisons.  The  following  Insert  uses  k 
comparisons,  so  this  method  requires  exactly  Tig  ml  comparisons  per 
cycle.  This  shows  that  Q(m)  < |~lg  ml  , giving  the  same  bound  on  the 
worst-case  number  of  comparisons  per  cycle  as  was  given  by  the  sorted 
linear  list  (or  loser  tree).  Since  this  binomial  queue  algorithm 
requires  a fixed  number  of  comparisons  per  cycle,  independent  of  key 
values,  it  does  not  give  any  better  bound  for  Q(m)  than  its  bound  for 
Q(m)  . 


3 Lower  Bounds. 
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One  approach  to  lower  bounds  on  the  number  of  comparisons  required 
to  maintain  a priority  queue  is  to  analyze  the  possible  internal  states 
of  the  queue  at  the  start  of  each  cycle.  This  is  possible  under  certain 
restrictions,  as  shown  in  the  next  section,  but  to  get  a general  lower 
bound  seems  to  require  a different  sort  of  argument  which  takes  advantage 
of  the  long-term  averaging  present  in  our  model. 

It  turns  out  to  be  quite  easy  to  prove  a good  lower  bound  on  Q(m)  . 
Suppose  that  a priority  queue  of  size  m requires  c(n,m)  comparisons, 
on  the  average,  to  perform  n cycles.  The  number  of  equally-likely 
outcomes  of  these  cycles  is  mn  , since  there  are  m equally-likely 
relative  sizes  for  each  of  the  n keys  inserted  during  the  cycles.  So 
by  the  same  decision-tree  argument  used  to  prove  lower  bounds  for  sorting 
[28,  p.  19^],  the  average  number  of  comparisons  required  to  determine 
which  outcome  has  occurred  is  at  least  n lg  m . But  it  is  possible  to 
determine  this  outcome  by  observing  the  outputs  of  the  n queue  cycles 
and  sorting  the  m keys  which  remain  in  the  queue.  Hence 

n lg  m < C(n,m) + 0(m  log  m) 
so 

i ^ tv—  C(n,m)  + 0(m  log  m)  . 

n -•<» 

This  also  implies  that  Q(m)  > lg  m . 

We  call  summarize  the  results  of  this  and  the  previous  section  as 
follows. 
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5.1*  A Characterization  or  Binomial  Queues. 

The  foregoing  results  show  that  binomial  queues  are  optimal  when 
the  queu- i : : z©  is  a i ower  oi  2 . Whet  the  queu<  ze  l j n )t  a j 5wer 
oi  2 , then  dummy  nodes  can  be  added  as  described  in  Section  5.2  to  make 
binomial  queues  nearly  optimal;  in  the  rest  of  this  section,  we  shall 
use  the  term  "binomial  queue"  to  refer  to  such  a structure. 

We  have  seen  that  l mear  lists  and  loser  trees  also  require  lg  m 
comparisons  per  cycle  when  m = 2K  , so  binomial  queues  are  not  the  only 
optimal  structure  for  this  problem.  But  neither  linear  lists  nor  loser 
trees  are  the  basis  for  a practical  priority  queue  algorithm.  We  have 
already  noted  that  comparisons  do  not  reflect  the  actual  running  time 
of  a priority  queue  using  a sorted  linear  list;  loser  trees  work  well 
lor  replacement  selection  but  are  awkward,  to  use  when  the  priority  queue 
size  may  change  with  time.  Our  comparison  model  evidently  does  not  capture 
the  factors  which  make  a given  priority  queue  scheme  difficult  to  implement. 

It  seems  extremely  difficult  to  evaluate  the  true  complexity  of  data 
structuring  problems;  the  linking  automaton  [51 ] appears  to  be  a good 
setting  for  such  questions,  but  few  results  have  been  obtained  for  this 
model.  A more  limited  approach,  closer  in  spirit  to  the  comparison-counting 
model  of  complexity,  is  to  restrict  our  consideration  to  algorithms  such 
that  the  underlying  structures  must  be  easy  to  implement.  Suppose  that 
the  only  elements  which  may  participate  in  comparisons  are  those  which 
are  not  known  to  be  larger  than  any  other  element  of  the  queue.  In  terms 
of  our  directed  graph  description  of  a priority  queue,  such  elements  have 
no  entering  edges;  they  are  candidates  for  being  the  smallest  element  in 
the  queue.  We  call  comparisons  between  such  elements 


ree  comp  ar : sons, 


since  they  j reserve  the  j.roj  erty  that  the  directed  graph  structure  c:  the 
.•  is  a tree,  (it  is  not  hard  to  see  that  a queue  which  make:  at  - ri 
■o!'q  arison  can  eventually  have  an  internal  structure  which  is  not  a tre>  . 
fince  a tree  is  much  easier  to  represent  and  operate  on  than  an  arbitrary 
directed  graph,  this  restriction  may  be  a reasonable  one. 

We  conjecture  that  binomial  queues  are  uniquely  optimal  (in  the  sense 
of  providing  the  tightest  upper  bound  on  Q(m)  ) among  all  priority  queue 
algorithms  which  make  only  tree  comparisons.  The  following  result  : ; a 
weakened  form  of  this  conjecture. 

Theorem  f.  The  only  priority  queue  which  makes  only  tree  comparison,  an 
which  makes  a number  of  comparisons  per  cycle  depending  only  on  the  queue 
size  is  the  binomial  queue. 

Iroo: . We  c insider  two  algorithms  to  be  the  same  if  their  directed  graph 
structures  are  the  same  after  each  comparison.  Suppose  that  an  algorithm 
makes  k = k(m)  comparisons  per  cycle  on  a queue  of  size  m . At  the 
start  of  each  cycle  the  smallest  element  is  known,  so  let  the  number  o" 
edges  leaving  this  node  at  the  start  of  the  i-th  cycle  be  d^  . Then  during 
the  i-th  cycle  the  algorithm  must  determine  which  of  d^+1  nodes  (the 
which  lost  to  the  smallest,  plus  the  inserted  node)  contains  the  smallest 
key.  By  the  restriction  to  tree  comparisons  this  takes  exactly  d_. 

• pari  sons ; hence  d^  = k on  every  cycle.  Thus  it  suffices  to  show  that 
any  tree  comparison  algorithm  in  which  the  smallest  node  (henceforth  called 
the  root ) has  a fixed  number  k = k(m)  of  offspring  for  a queue  of  size  r. 
is  the  same  as  the  binomial  queue  algorithm. 

We  are  therefore  led  to  consider  adversaries  which  attempt  to  make  the 
degree  of  the  root  fluctuate.  It  will  be  helpful  to  first  consider  twe 


simpler  adversaries;  one  whi ch  attempts  to  maximize  the  degree  of  the 
root  on  a single  cycle,  and  another  which  attempts  to  minimize  it.  Since 
max  is  an  increasing  function  of  its  arguments,  a maximizing  adversary 
can  do  no  better  than  to  maximize  the  degree  of  the  node  which  is  smaller 
at  each  comparison;  similarly,  the  minimizing  adversary  will  minimize  this 
quantity.  If  the  two  unbeaten  nodes  to  be  compared  have  degrees  and 

dg  then  the  maximum  (minimum)  resulting  degree  is  max(d^, d0)+l 
(min(d^, dg )+l)  . What  strategy  can  the  algorithm  use  to  minimize  the 
degree  of  the  root  against  a maximizing  adversary,  or  maximize  this 
quantity  against  a minimizing  adversary? 

It  is  useful  to  abstract  this  question  into  a problem  on  extended 
binary  trees;  we  are  given  a vector  (wi}, w^,  ..  ,,wk)  of  k+1  real-valued 
weights,  corresponding  to  the  degrees  of  the  k+1  nodes  to  be  compared, 
and  a function  f which  may  be  max  or  min  . For  any  binary  tree  having 
k+1  external  nodes  we  associate  a real-valued  cost  with  each  node.  The 
weights  w^  are  assigned  as  costs  to  the  external  nodes,  and  the  costs  of 
internal  nodes  are  computed  via  the  rule;  if  the  two  offspring  of  a node 
have  costs  u and  v then  the  cost  of  the  node  is  l+f(u,v)  . Hence  the 
cost  of  an  internal-  node  is  just  the  degree  of  the  node  which  wins  the 
corresponding  comparison  under  the  adversaries  considered  above.  We  define 
the  cost  of  the  resulting  binary  tree  to  be  the  cost  of  the  root,  so  our 
problem  is  to  find  a binary  tree  of  minimum  cost  when  f = max  , or  maximum 
cost  when  f = min  . We  shall  call  such  trees  optimal. 

One  method  of  constructing  an  appropriately  labeled  binary  tree  is  to 
use  Huffman's  algorithm  [16],  The  first  step  in  this  procedure  is  to  select 
the  two  smallest  weights  from  the  vector  (Wq,  w^, w^,  . . ,,w^)  , say  w, . 


and  w , . Then  solve  the  problem  for  the  k weight. 

( 3 ■ :,(v1,Wj',w0,...,wk'1  . Finally,  replace  the  external  node  containing 
1+  f(w,,w^)  with  the  binary  tree 


The  tree  which  results  from  this  procedure  is  called  a Huffman  tree. 

Lemma  1.  A Huffman  tree  is  optimal  when  f = max  and  when  f = min  . 

Proof.  (This  proof  is  similar  to  the  proof  that  Huffman  trees  have 

minimum  weighted  external  path  length,  given  in  [2 6,  p.  L03 ] ; a different 
proof  for  the  case  f = max  is  given  in  [14].)  We  argue  by  induction 
on  k , the  result  being  obvious  when  k = 0 . It  is  sufficient  to  show 
that  when  k > 0 , there  is  an  optimal  tree  T in  which  the  two  smallest 
weights,  say  w^  and  w^  , are  contained  in  external  nodes  which  are 
offspring  of  the  same  internal  node.  To  see  why  this  is  enough,  first 
note  that  by  the  induction  hypothesis,  the  reduced  problem  of  finding  an 
optimal  tree  for  the  weights  (1+  f(w,y  w^),w?,  . . ,,w^)  is  solved  by 
Huffman's  algorithm.  Call  the  Huffman  tree  for  the  reduced  problem  R ; 
then  the  cost  of  R is  not  worse  than  the  cost  of  T because  a solution 
to  the  reduced  problem,  which  R solves  optimally,  is  imbedded  in  T . 
But  the  tree  R differs  from  the  Huffman  tree  for  the  original  problem 
only  in  the  replacement  of  one  external  node,  which  does  not  change  the 
cost  of  the  root.  Hence  the  Huffman  tree  for  the  original  problem  is 
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optimal. 


A second  observation  is  that  the  cost  of  a tree  is  actually  determined 
solely  by  the  levels  on  which  the  weights  w, ,, w, , . . . , w.  appear.  The  cost 

of  the  root  is  simply  t'(l,^w,  , t^  + w^  , , (y  *-  w^)  where  l.  is  the 

level  on  which  weight  w^  appears  in  an  external  node. 

We  shall  prove  that  the  two  smallest  weights,  w(J  and  w , may  both 
appear  on  the  deepest  level  in  an  optimal  tree.  Since  there  are  at  least 
two  external  nodes  at  this  level  and  weights  on  the  same  level  can  be 
rearranged  arbitrarily,  this  will  give  the  result.  Suppose  that  w. 
appears  at  level  and  that  w^  > wQ  appears  at  level  f > . 

Consider  the  case  f = max  ; the  effect  of  w„  and  w.  on  the  cost  r 

0 j 

of  the  root  is  to  guarantee  that  r > max(frt+w^,  l .+ w.)  = llw.  . If 

0 0’  j 2 J 3 

wn  and  w.  are  exchanged,  these  nodes  only  force 
r > max(f  .+w_,  £.+w.)  < t .+ w.  , so  the  switch  can  only  reduce  r . 

- ' J 0 ’ 0 j ' j j ’ J 

In  the  case  f = min  , we  have  r < min(/_+w_,  l .+ w.)  = l+  wr.  before 

- v 0 0 3 j 0 0 

the  switch,  and  r < min(fj+wQ,  £Q+  w^. ) ■ -fg+wg  after,  so  the  exchange 

can  only  increase  r . □ 

Using  Lemma  1,  we  can  construct  the  more  complicated  adversary  needed 
to  establish  a strong  restriction  on  the  algorithms  which  make  a fixed 
number  of  comparisons  per  cycle. 

Lemma  2.  A necessary  condition  for  an  algorithm  using  only  tree 
comparisons  to  have  a fixed  degree  k at  the  root  at  the  start  of  each 
cycle  is  that  the  out -degrees  of  the  offspring  of  the  root  be  k-1, k-2, . . . , 1, 
at  the  start  of  each  cycle. 

Proof.  Suppose  that  the  degrees  of  the  root’s  offspring,  listed  in 
decreasing  order,  are  dy  ^d^  . ..,d^, dQ  . 


We  define  an  adversary  which 


causes  the  degree  of  the  root  to  differ  from  k if  the  above  degrees  are 
not  k-1,  k-2,  . . . , 1, 0 . The  strategy  depends  on  the  first  left-to-righ*. 
discrepancy  between  the  two  sequences.  Suppose  f is  the  largest  index 
such  that  d^  * f ; then  there  are  two  cases  according  to  the  relative 
sizes  of  d,,  and  f . 

Case  1.  d ">  f . The  adversary  attempts  to  maximize  the  degree  of  the 
root.  Since  offspring  with  degrees  k-1,  k-2,  . . . , f+1  , and  d^  _ f+1 
are  present,  along  with  the  inserted  node  of  degree  0 , it  is  easy  to 
see  by  Lemma  1 that  even  when  the  algorithm  uses  an  optimal  strategy 
against  the  maximizing  adversary,  the  resulting  degree  is  > k+1  . 

Case  2.  d,  - f . The  adversary  attempts  to  minimize  the  degree  of  the 

root  unless  a premature  comparison  occurs;  the  i-th  comparison  is  premature 

if  it  involves  d.  where  j > max(i-l,  f)  . Informally,  this  means  that 
J 

to  avoid  a premature  comparison,  the  algorithm  must  first  perform  a series 
of  f+1  comparisons  involving  only  the  newly  inserted  element  of  degree  0 
and  the  f+1  trees  whose  roots  have  degrees  d^  < d^  < . . . < d < f . 

This  results  in  a single  tree  which  is  compared  with  the  root  of  degree 
d?+1  = f+1  ; the  result  of  this  is  then  compared  with  the  root  of  degree 
d^+2  = f+2  , and  so  on  until  a single  tree  remains. 

If  no  premature  comparison  occurs,  then  by  Lemma  1 the  tree  which 
results  from  the  first  set  of  f+1  comparisons  has  degree  < f , so  the 
final  result  has  degree  < k-1  . If  a premature  comparison  occurs  then 
the  adversary  changes  to  a maximizing  strategy  on  that  comparison  and  for 
all  those  which  follow.  An  argument  similar  to  the  one  used  in  Case  1 


shows  that  the  resulting  degree  is  then  > k+1  . 
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We  can  finally  prove  the  theorem.  First  note  that  if  the  offspring 
of  the  root  have  out-degrees  k-1, k-2, . . . , 0 , then  comparisons  must 
proceed  as  in  the  binomial  queue  algorithm  in  order  to  guarantee  that 
the  root's  degree  remains  at  k . That  is,  the  inserted  node  is  compared 
to  the  degree  0 offspring,  then  this  result  is  compared  to  the  degree  1 
offspring,  and  so  on.  This  follows  from  Lemma  1 using  either  the 
maximizing  or  minimizing  adversary. 

Now  order  the  offspring  of  each  node  in  the  directed  graph  structure 
of  the  queue  by  their  out-degrees,  decreasing  from  left  to  right.  Find 
a structure  arising  during  the  operation  of  the  given  priority  queue 
algorithm  which  differs  from  the  binomial  queue  structure  at  some  point, 
such  that  this  discrepancy  is  as  shallow  (close  to  the  root)  as  possible. 
The  discrepancy  can't  occur  at  the  root,  and  it  can't  occur  at  an  offspring 
of  the  root  by  Lemma  2.  If  it  occurs  deeper  in  the  tree,  then  one  cycle 
of  the  queue  can  move  it  toward  the  root  as  shown  (X  is  the  subtree 
containing  the  mismatch); 


This  contradicts  the  assumption  that  the  discrepancy  was  shallowest,  and 
completes  the  proof.  □ 


It  seems  quite  unlikely  that  an  exhaustive  analysis  of  this  kind 

can  prove  the  conjecture  stated  above. 
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Discussion, 


Huffman  trees  were  originally  used  to  find  an  extended  binary  tree 
solving  the  problem 

min  Y.  i . • w. 

, . 11 
1 ^ 1 _ n 

The  proof  of  Lemma  1 shows  that  Huffman' s algorithm  also  finds  trees  which 
optimize 

min  max  (£.+w.) 

1 < i <n  1 1 


and 


max  min  (£.+ w. ) 
Kiln  1 1 


The  first  of  these  problems  can  be  interpreted  as  a scheduling  problem  on 
n parallel  processors:  we  have  n jobs  with  running  times  w^,  v , . . . , w;. 

whose  results  must  be  combined  pairwise,  at  unit  cost,  before  a final 
answer  is  obtained.  Huffman  trees  minimize  the  time  to  compute  the  final 
answer  in  this  situation.  Both  problems  can  be  interpreted  in  terms  of  a 
circuit-design  problem:  we  have  n.  devices  with  propagation  delays 

w-, , w, , . . .,  w,(  whose  outputs  must  be  combined  pairwise,  at  unit  delay, 
to  give  a single  output.  One  Huffman  tree  minimizes  the  maximum 
propagation  delay;  the  other  maximizes  the  minimum  delay.  The  latter 
property  can  be  significant  if  the  circuit  is  part  of  a pipeline. 

There  are  as  many  possible  settings  for  priority  queue  complexity 
as  there  are  applications  of  priority  queues.  The  one  chosen  here  is 
simple,  yet  seems  representative.  An  obvious  generalization  is  to  allow 
the  queue  size  to  fluctuate  in  a regular  fashion  between  two  widely-spaced 
values,  such  as  m and  m/2  . In  this  situation  our  lower  bound  on  Q(m) 
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becomes  lg  m-lg(e/2)  , and  the  upper  bounds  on  Q(m)  and  Q,(rn)  given 
by  sorted  linear  lists  are  again  nearly  tight.  But  the  loser  tree  and 
binomial  queue  structures  used  to  prove  upper  bounds  in  the  simpler 
model  do  not  apply  in  this  situation,  since  they  do  not  grow  and  shrink 
gracefully.  It  would  be  interesting  to  find  a structure  which  is  nearly 
optimal  in  the  more  general  model  and  can  actually  be  implemented  to  run 
. n time  pr>portional  to  the  number  of  comparisons. 

It  is  an  open  problem  to  improve  upon  the  upper  and  lower  bounas  on 
.pm  or  Q(m)  when  m is  not  a power  of  2 . It  would  also  be 

interesting  to  prove  results  to  the  effect  that  arithmetic  on  keys  cannot 

he ip,  in  the  worst  case  or  on  the  average,  when  the  key  space  is  large 
compared  to  the  queue  size;  results  of  this  kind  have  been  shown  for 
selection  problems  [ U3 ; 13 ] . When  the  key  space  is  restricted  to  the 
integers  from  1 to  m and  arithmetic  on  keys  is  allowed,  then  the 
priority  queue  operations  can  be  implemented  to  run  in  O(log  log  m) 
time  [Uo], 

Our  abstract  study  of  priority  queues  has  shown  that  binomial  queues 

of  size  m = 2 are  a particularly  simple  and  efficient  structure  for 

implementing  alternating  Insertions  .and  deletions,  such  as  occur  in 
replacement  selection.  When  m is  not  a power  of  2 , fewer  than  lg  n 
dummy  nodes  must  be  added  to  make  the  queue  behave  as  such,  since  the 
algorithms  never  look  below  a node  containing  an  infinitely  large  key. 
Hence  binomial  queues  may  be  a useful  alternative  to  loser  trees  for 
replacement  selection. 
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Appendix.  Priority  Queue  Implement 


‘ '--'AIL  Io:n<  -ru  v ’ . 


1.1  3inO::li  '-il  uz ;.r  CtrU'.-lure  1',  . 


I 


) 


COMMENT  Ri  iority  queue  routines  using  structure  R for  binomial  trees. 

Notes  on  the  subset  of  SAIL  used  here: 

1)  is  the  exchange  operator. 

2)  'DONE  "bn"'  cause1  the  loop  on  block  named  "bn"  to  be  exited. 

3)  fill  nnp^rOlNItn  parameters  are  passed  by  value. 

About  programming  style: 

These  routines  are  not  intended  to  be  an  easy  intoduction  to  binomial  queues. 
Instead  they  are  meant  to  be  a guide  to  efficient  implementation  of  binomial 
queue  operations,  as  might  he  accomplished  in  assembly  language.  This  m*  ins 
that  m these  procedures  a large  amount  of  state  is  kept  Implicitly  in  tin 
f I ou  c>  f control,  rather  than  in  program  variables.  He  have  not  att'ipted 
to  perform  other  optimizations,  such  as  the  assignment  of  registers,  r mce 
the  e can  he  per  formed  without  a global  understanding  of  the  algorithms. 

About  mnemonics: 

Identifier  names  are  intended  to  convey  meaning  when  possible,  but  have 
a I so  been  kept  reasonably  short.  Names  are  generally  a concatenation  of 
short  tags  which  are  abbreviations  of  something  meaningful:  Rt  for  root, 

Nxt  for  next,  etc.  Capitalization  is  used  to  delimit  the  tags,  so  "the 
new  rightmost  root"  is  written  newRtmRt.  Happy  reading!: 


BEGIN  "R i nom i a I Queue" 
REQUIRE  " II  DELI  Ml  TEFiS; 


RECORD  U ASS  Node 

(RE COnn_PO INTER (Node)  ISibling!,  IChi Id' j I NTEGER  Key  1 ) : 

COMMENT  Abbreviations  for  Node  fields:; 

DEE  1 ME  1 5 i b I i ng  = INode : 1 5 i b I i ng  1 1 ; 

DEFINE  I Chi  lc)  - INode:  iChi  Id!  I ; 

DEFINE  Key  «■  INode:  Key  1 1 ; 

RECORD. Cl  AGO  QurueHeader  (RFC0R0..P0I NTER iNode)  lef tmostRoot;  INTEGER  -c  l; 

BOOLEAN  PROCEDURE  ODD (I NTEGER  i); 

RETURN!  i l AND  ] ) ; 
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PROrrnnni  Insert  (RrCORDPO INTER  (Node)  Xi  RECORD  POINTER  (QueueHeader ) 01; 

BEGIN  'insert" 

HICUHR  POlNTlH(Nutle)  rtmRt,  nxtRt; 

JNTLr.ER  t.; 

s * Q.  ii-ueHender : S i ze  IQ) ; 

IE  s ^ 0 THEN  i tmRt  * IS  i b I i ng  [QueueHeader:  I e f tmos  tRoo  t IQ] ) ; 

I Child  lx)  . NIX  I RECORD; 
if  ouj(s)  nit n bi r.;iN 

"The  rightmost  tree  in  c|  consists  of  a single  node;  merge  it  int  x.  ( T t , . me 
of  bfl' ; i'  treated  specially  to  eliminate  a test  from  the  inne'  lc>cp.  I” 
nxtRt  • IS  ibl  ing  Ir  tniHt] ; 

If  Ktiilxl  ■ KeylrtmRt)  THEN  x « rtmRt; 

IClii  I il  tx)  *-  r tmRt ; 

ISihl  i in ib  tmRt)  • rtmRt; 

LIH1LF  TRUE  DO  BEGIN  "NergeLoop" 
rtmRt  *■  nxtFlt;  s «•  s/21; 

If  -CHID  Is)  THEN  DONE  “NergeLoop" ; 

"The  rightmost  tree  remaining  is  thr  same  size  as  x;  merge  it  into  x.  " 
nxtFlt  e IS  i b I i ng  [r  tmRt ) ; 

II  Keylx)  • KeylrtmRt)  THEN  x « rtmRt; 

ISihl  in  i Ir  tmRt  j * IS  ibl  ing  ( IChi  Id  [x]  ] ; 

IS  i h I iny  1 1C  hi  Id  lx) ) ♦-  rtmRt; 

I Eli  i I cl  lx)  * rtmRt 
CUD  ’Her gel. oop " 

END; 

IF  5 3 It  BEGIN 

"The  entire  forest  has  been  merged  into  x.  (The  forest  size  is  a power  of  twe 
I S i h I i ncj  I x]  t x ; 

QueneH  rider : I ef  tmos  tRoo  t IQ)  «-  x 
END 

ELSE  BEGIN 

"Some  of  the  original  forest  remains;  x is  the  rightmost  rout  in  the  non  fere 
I S i I ■ ■ i (QueueHeader ; I ef  tmos  tRoot  IQ)  J ♦-  x; 

IF.it  • v i ( x 1 * rtmRt 

END; 

Queud  idc  r:SizelQ)  *-  QueueHeader ; S i ze  lu)  + 1; 

END  " i riser  t " ; 


79 


Rt  ’ ■ . 1 • ii  • ) f RdCHH  l,r.[  Lk*  I eteSmal  lest  (RE  CORO_PO INTER  (QucueHe.ider ) CJ  > ; 

PI  I • i i.  • I ( t ► ' i rn ;i  I I r r t ' 

Ht  > • 1 I • 1 1 NTLR  (Node)  IfniRt,  < tmRt,  smallest,  pred*  succ,  smal  l estPrecl,  rtmChilci, 

ri»  i • f iRt,  mr  ciTrco,  nxtTrec; 

INK  1 •(  R ■ . si  i • 1 1 I tlC^'u : 

) Ih;M  • J.  i»?ue)  leader:  lr  MmoctRoot  IQ] ; r t mR  t *-  iSibl  iny  (I  f n»R  1 3 ; 

5 • IJ*  )•  i jcHrdder : S i re*  ICJ) ; 

If  I t nii  i = r tmRt  THEN  BE  GIN  "There  is  only  one  tree  in  the  forest." 

'in  In'ii  tin  i 't,  and  make  the  new  foiest  froni  its  sons." 

"ill.  t . I fmlft; 

l.  " ■ 1 '• . , I',  i : I e f t nios  tRoo  t tU)  < ICh  i Id  [ I f mR  t ) 

E N[  1 ll"ir-  in  only  one  ti  < in  the  forest.” 

El  t 1 -If.  "There  ire  two  01  more  trees  iri  the  forest." 

i ii  f 1 1 1 the  node  containing  the  smallest  key  in  the  queue." 

i inyilfmRt]  * NULL.  f(i  i.ORD;  "Mark  the  leftmost  node  to  stop  search." 
a u tKei|  •-  key  1 I t mR 1 1 ; pred  ► IfmRt;  succ  *-  rtmRt; 

Dll  MG  IN 

If  n'.i I I es tkey  > key(succ)  THEN  BEGIN 

i lie  tkey  - key  [sure];  small  estPred  *-  pred  END; 

I"'  l * succ;  nice  «-  I S i b I ing  [succ] 
f Nil  DU  II  succ  =-  NULL  .RECORD; 

1 i 1 1 I r t • I S i h I i ng  [sma  I let.  tT'red] ; 

IT  si  • it  le.t  NULL_RCCORD  THEN  BEGIN  "The  rightmost  root  is  smallest." 

t ma t I t ' t • i tmR t ; 

IE  OLIO (s)  THEN 

r i yii  tmos  t tree  is  a single  node;  just  remove  it  from  the  forest." 
i h i i ' i 1 1 !if  mR  1 3 *-  I S i b I i ng  [ sma  I I e s t ) 

LIRE  BEGIN 

"Hit  sons  ot  the  rightmost  root  become  the  smallest  trees  in  the  new  forest. 
I S i P I i ng  [ I f niRt  J *-  ISibl  ing  ( IChi  Id  [smal  lest]  ] ; 

I S i P I i mi  1 1C h i Id  [sma  I I es t ] j «-  IS ibl  i ng  [smal  I estl 
END 

ENLi  "ilir  rightmost  root  is  smallest." 

SI  i BE  GIN  "A  root  other  than  t tie  rightmost  is  smallest." 

u ■ containing  this  root  must  be  replaced.  A replacement  tree  is  formed 
t ''i  i r o.i  the  rightmost  tree  in  the  forest  with  the  children  of  the  removed 

' it.  (Iiilrlren  which  are  smaller  in  sire  than  the  rightmost  tree  become  the 

Mile  t ti  ecs  in  the  ncu  forest." 
r 1 1 if  h i I rl  • I :>  i b I i ng  [ I Ch  i I d [ sma  I lest)]  : 

i i I i ny  [ I Ch  i I cl  Isma  I lest]]  • NULL.RECORO;  "Hark  leftmost  child  to  stop  scan,  " 

IF  --ODD ( s ) THEN  BEGIN 

" I hf  rirue  sire  was  even  before  the  deletion,  so  some  chiltlren  of  the 
rs-r, loved  root  will  move  up  to  become  the  smallest  trees  in  the  neu  forest. 
Oran  through  the  children  until  mrgTree,  the  one  which  will  merge  with 
the  r iylitmost  tree  in  the  forest,  is  reached." 
nr  mH  t ml!  t » r t mCh  i I d; 

' • s/2; 

WHILE  -OUtlls)  DO  BEGIN 

rtmC.hild  * ISi bl  ing [r  tmChi  Id] ; s * s/2  END; 

MrgTree  •-  I S i b ling  [r  tmCti  i I d] ; 

IE  sma  I I s-s  tT'red  = rtmRt  1HEN 

"Thr  tree  to  the  right  of  the  removed  root  is  the  rightmost  tree,  and  thus 
will  be  consumed  in  building  the  replacement  tree.  So  the  replacement’s 
predecessor  will  Pe  the  leftmost  child  which  moves  up." 
sma  I I es  tPred  *-  rtmChild 
El  SL 

"l  ink  the  children  into  the  right  of  the  ferest  now,  since  their  ISibl ing 
if  not  the  replacement  and  is  therefore  known." 

IG  ih  I ing  (r  tmChi  Id]  <•  ISibl  ifigfr  tmRt) 


$ 


(*■ 

,* 

f. 

* 


[Nil 

t L SF-  BEGIN 

"The  queue  size  is  odd,  so  all  children  of  the  removed  root  nil  I he  used 
to  make  the  r ep  I acement . " 
neuRtluRt  »-  ISi  b I ing  Ir  tmR  tl  ; 

If  smallestPred  ■=  rtmRt  THEN 

"The  replacement  tree  nil  I he  the  rightmost  tree  in  the  neu  forest:  hence 
neiiRtmRt  and  smallestPred  cannot  be  given  true  values  non.  Flag 
this  with  smallestPred  = NULL.  RECORD. " 
smallestPred  • Nl  II  l . RECORD; 

"FVr  foi  m the  first  merge.  The  merge  of  B0‘s  is  handled  specially  in  order 
remove  a test  from  the  inner  loop." 
nircilree  * IS i bl  i ng  [r  tmCh i I d) : 

If  K'i  y Ir  tinRt)  > key  fr  tmCh  i I d)  THEN  rtmRt  « rtmChild; 

ICh  i l d tr  tmRtl  «-  rtmChild; 

ISi  t>  I i ng  [r  tmCh  i Id]  *-  rtmChild 
END; 

"Complete  the  merge." 

UHII  F nuglree  * NULL  RECORD  DO  BEhIN 
nxtlree  •-  iS ib I i ng  (mrgTreeJ ; 

If  k'eulrtmRt)  > Key(mrgTree)  THEN  rtmRt  « mrgTree; 

I'il  I i ng  [mrgTree]  <-  IS i b I i ng  ( IChi  I d tr  tmRt]  ] ; 

IS  1 i g ! I Chi  I d Ir  tmRt)  1 *■  mrgTree; 
dt-  t mR 1 1 x mrgTree; 
i r t <•  ox t Tree; 

END. 

"I  i «i  1 1 ns  to  fix  up  some  links  between  roots  in  the  forest:  1)  (Sibling  link 
horn  leftmost  root  to  rightmost  root,  2)  ISihling  link  from  replacement  tree 
to  the  next  larger  t ■ ■ ^ . and  3)  ISibling  link  to  replacement  tree  from  the 
nex*  smaller  tree.  Many  forms  of  degeneracy  are  possible..." 

IF  v in  I I e t ■=  IfmRt  1HEN  BEGIN 

i no  leftmost  tree  was  replaced,  so  link  from  header  must  be  fixed." 

C ruel leader : I ef  tmos tRoot  IQ]  *-  rtmRt: 
i nuilestPred  = NUl  L_REC0RD  THEN 

1 i en1 acement  tree  is  the  only  tree  in  the  forest:  1),  21.  and  3)  are 
identic  a I . " 

IS  i bl i ng tr tmRt ] < rtmRt 
E1SE  Bn. IN 

"h'.  e if  another  tree  in  the  forest,  besides  the  replacement:  ])  and  2) 
are  identical." 
i r i h r.g  Ir  tmRt ) x row  RtmRt: 
i 1 1 1 i ng  (sma  I I es  tPred)  •-  rtmRt 
END 
END 

ELSE  BEGIN 

'There  is  a tree  larger  than  the  replacement,  so  2)  can  he  filled  in  non." 

ISi  bl  inci  tr  tmRt]  »-  IS  i h I i ng  [smal  I est) : 

IF  • ma  I I es  tPred  - NOLI  .RECORD  THEN 

"There  is  no  tree  smaller  than  the  replacement:  1)  and  3)  arc  identical." 
IS  i b I i nu [ I f mRt ) x r tmRt 
SI  SE  BfGIN 

"The  nondegenerate  case:  1),  2),  and  3)  are  distinct." 

I S i b I i ng  [ I f mRt]  x nenRtmRt: 

I S i b I i ng  [sma  I I es  tPr  ed)  x rtmRt 
END 
END 

END  "A  toot  other  than  the  rightmost  is  smallest." 

END  "There  are  two  or  more  trees  in  the  forest.": 

Oueuel leader : S i zc  [Q]  x Queucflcader : S i ze  IQ]  - 1: 

I S i l>  I i ng  tsma  I I es  t]  x ICh  i I d (sma  I lest]  x NLILL_RECORDj 
RETURN (sma I lest) 

END  " Dc I e t eSma I lest" ; 
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F'KiUTiit K .1  Union  (tiLC0RD_ POINTER (QueueHeader ) F.  Ql- 
EILG1N  "Union” 

Fin  nun  F’O  INTER  (Node)  ARRAY  RkU:3]- 
lNTtr;Ff(  i; 

Funmfjf  E'k  i:  a stack  of  Bk  trees  uhich  is  accumulated  for  each  stage  of 
tU-  ''•''lilit.cn".  "Carries”  are  propogated  through  Bk  111  . The  integer  i 
1 1 1 1 k pointer,  i . e.  , it  i s the  number  of  trees  in  the  s tu<  k . • 

FiFtifU  E’OI  NFI  fl  (Node)  rF,  . Q,  rF,  dummy; 

CfltiniNI  " ,0  thfl  largest  tree  in  the  result  forest  uhich  has  Peer, 

■ i'  uti  a ted.  : 

I Nil  1 -riv  si . • rj; 

' ' Hr  i'i"r:  a.’e  IF)  ; IF  sl.'0  THEN  rF  e ISibl  ing (QueueHeader:  Inf  truest  Root  [F] ) 

J " '••  I.’r'  r - ' T e 1C'r : K sl)<B  M rO  * ISibl  ingtClueueHeadc-r:  lef  t woe t Root  IQ]  ] 

d"'  ■ ■ NI  LI_RE  CORD  (Node) ; rF  * dummy; 

i • FI; 

"Flu-  binary  addition  algorithm." 

]!Fh0r«!?oFtrTirNrBtG»r‘,ed  EPCC'a"y  to  rem°Ve  tests  ,rom  the 

1 ' "•  1 '•  CkE'i  r t-F;  rl  e ISibl  ingErTJ  END: 

IF  DEUlfsQ)  THEN  BEGIN 

1 • ' + 1:  F • k.  ( t J . rfi;  r Cl  ISibl  inn  [rQ]  END; 

IF  i 1 THEN  BEGIN 

ISibl  incitrD  • EV11F;  rF  . RkEl);  i e 0 END- 
If  i WIN  BEGIN 

IF  Keu  (Bk  [ill  > KeuEBkE2)]  THEN  Bk  Eli  « Bk  I2J  • 

I Chi  I d (Bk  Ell)  . Bk  121 ; 
i inn  EHk  (?i  ] - Bk  (2)  ; 

i e j 

END : 

sF  - s 1/2;  sR  . sFl/2; 

" F he  general  step." 

WHILE  (sF  » pi  v ( sQ  » 01  CIO  BEGIN 
IE  OUri(sF)  THEN  BEGIN 

i - |-*1;  Bk  [ i ] rF;  rT  e ISibl  i ng  IrT)  END: 

IE  OflOIsQ)  FIICN  BEGIN 

' • i-tj;  Ek  I i 1 ^ rQ;  rCJ  - ISibl  i nr;  [rQ]  END; 

IF  ( i - 1 ) v ( i = 3)  FUEN  BEGIN 

ISibl  inglrFJ  > Bk  I i ] ; rf  * BkEil;  i - \ END- 
IE  ' FHEN  BEGIN 

IF  Keg  [Bk  111)  >Key[E3kI2]J  THEN  Bk  II]  » Bk  [2] ; 

IS  ih  I in. i [Bk  12)  J » ISibl  i ng  I IChi  Id  EBk  [1111; 

I S i h I muIlChi  IdlBkimi  e Bk  (21  ; 

I Chi  I cl  [Bk  II  J]  Bk  12 1 : 


EMU: 


END: 


sF/2;  sQ  - sQ/2 


Hanifle  a carry  off  tfie  end,  if  present." 

IF  i . 1 THEN  BEGIN 

ISibl  inglrFJ  < Bk  (1  ] ; rf  e Bkll]  END; 

"Lint  the  result  into  0,  and  clear  out  T." 

ISibl  i ng  IrT  J * IS i b I ing (dummy] ; 

"At  this  point  the  dummy  node  can  pc  explicitly  deallocated  to  save  G r-s  ' 
Utreutll.  irler : I r f twos  tRoo  t [Fj]  * rF; 

t-junr  w rder : S i re  IQ)  • Du-  uel leader  ;S i ze  (T  J + QueueHeader j S i ze  [Ql  • 
QucucHr-idor:  lef  t most  Root  ID  • MULL  RECORD; 

QueurHr  nder  : Si  Ze  [I ) •-  0; 

END  "Union"} 


1,  Bin  ;:ual  Queue  using  Structure  K . 


COMMENT  Priority  queue  routines  using  structure  K for  binomial  trees. 

Note'.,  on  the  subset  of  SAIL  usetl  here: 

1)  is  the  exchange  operator. 

D ’[iiTNF  "iin"'  cause:  the  loop  on  block  named  "bn"  to  be  exited. 

3)  Ell  CORO_ROINTER  parameters  are  passed  by  value. 

About  programming  style: 

These  routine',  are  not  intended  to  be  an  easy  intoduction  to  binomial  queues. 
Instead  they  are  meant  to  be  a guide  to  efficient  implementation  of  binomial 
queue  operations.,  as  might  he  accomplished  in  assembly  language.  Inis  means 
that  in  the'*'  procedures  a large  amount  of  state  is  kept  implicitly  in  the 
flou  of  control,  rather  than  in  program  variables.  Ue  have  not  attempted 
to  perform  other  op t i m i ?a t i ons,  such  as  the  assignment  of  registers,  since 
these  can  be  performed  without  a global  understanding  of  the  algorithms. 

About  mnemonics: 

Identifier  names  are  intended  to  convey  meaning  when  possible,  but  have 
also  been  kept  reasonably  short.  Names  are  generally  a concatenation  of 
short  tags  which  are  abbreviations  of  something  meaningful:  Rt  for  root, 

Nxt  fni  next,  etc.  Capitalization  is  used  to  delimit  the  tags,  so  "the 
new  rightmost  root"  is  written  newRtmRt.  Happy  reading1; 


DfGIN  i nom  i a I Queue" 
REQUIRE  "lie"  DEI  1 MITERS: 


RECORD  CLASS  Node 

(RECORD  POI  NTtR  (ANY_Cl  ASSI  ISibling!;  RF.C0R0_P0i  NTER  (Node)  I Ch  i Id1;  INTEGER  Key! ) ; 

COMMENT  The  ISibling!  field  is  declared  ANY_CLASS  because  it  must  refer  to  records 
of  class  QueueHeader  as  well  as  class  Node.  SAIL  do' 3 not  handle  forward 
REC0RD_CL ASS  declarations  correctly.; 

COMMENT  Abbreviations  for  Node  fields:; 

DEFINE  ISibling  = INode: ISibl  ing!  I ; 

DEFINE  IChi Id  i INode: I Ch i Id!  I : 

DEFINE  key  - INode: Key!); 

RECORD  CLASS  QueueHeader 

(RECORD.  POINTER (Node)  ISibl  ing1,  IChi Id';  INTEGER  S i ze> ; 

COMMENT  It  is  essential  that  ISibling!  have  the  same  offset  in  both  Node  and 
Queuellei'ler,  since  the  condition  ISibling!  ■=  NULL_REC0R0  is  what  distinguishes 
header  nodes  tiom  others.  In  some  programming  languages  (e.g.  Simula)  thrre  arc 
facilities  foi  declaring  such  restrictions  explicitly.; 

BOOLEAN  PROCEDURE  ODD (INTEGER  i); 

RETURN (i  LAND  1); 


runt  H if  :•  ln>.it  (RECORD  POINTER (Node)  x;  RECORELPOINTER  (QueueHeacfer  ) Cl  I; 

BEGIN  " 1 n?r>t  t" 

IlirniO  POINTER (Node)  rtmRt,  nxtKt; 

INIti.rii  s; 

s • Cloi'iii'He  ider  : 5 i ze  (QJ ; 
rtmRt  • GncucHencler:  ICh  i Id!  FCI]  i 

1C  hi  Id  lx)  . NULL  RECORD; 

If  f l{ ifl (r.)  TFIFN  BEGIN 

"ii,.  i i r tl  i t in*  ■ ■ . t tree  in  U consists  of  a single  node;  merge  it  into  x.  (The  merge 
o f Rif's  is  treated  specially  to  eliminate  a test  from  the  inner  loop.)" 
nxtUt  * I S i h I i nt;  [r  tnR  1 1 ; 
if  K.  ylxj  > Key (rtmRt)  THIN  x « rtmRt; 

I C h i I r.l  [ x)  * r tmR  t ; 

Ullll  I TRUE  Du  BEGIN  "Etc  i cml  oop" 
i I mi  I I • i ix  t R t ; s *-  / ; 

II  >0liLl(  ) THIN  DONE  "Her  cieLoop" ; 

III.  i iyhtmost  ti  to  i riiiaining  is  the  same  sire  as  x;  merge  it  into  x.  " 

1 1 v 1 1 1 1 I G i p I i ny  ti  t niFt  t. ) ; 

If  Kcy(x)  • Key  tr  tuiRtl  THEN  x « rtmRt; 

1 1 > i G I i ny  l Kill  i I d (r  t mR  t)  ] *-  IChildtx); 

I S i Ii  I i ny  t iCh  i I d fx]  ] ♦ rtmRt; 

I L h i I tl  [x]  ► r tmR  t 
[Nil  "lit  i gr!  oop"; 

I G i I i I i ny  [ I El  i i I d t x ) ) «-  Q 

END; 

QueueU.’  ader  : IChi  Id1  tQ)  «-  x; 

IF  If  THEN 

"It"  t-n  - foi  est  has  been  merged  into  x.  (The  forest  sire  is  a poner  of  tiro.) 

I !■ ■>  i I > I i ny  [ xj  * (J 
ELSl  EH  GIN 

in.'  of  tlic  original  forest  remains;  x is  the  rightmost  root  in  the  new  forest 
I . 1 1 • I i n « j t x ) •-  rtmRt; 

I S i ti  l i ny  [ I Ch  i I d [r  tmFI  t)  I «-  x 
END; 

Otic  iieFl.  adei  : S i re  IQI  <-  QueueHeaderjSi  ze  (Cl)  + 1; 

END  "Insert"; 


i 
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RECORD  F'DINILIMNodo)  F'RDCEDURE  On I e teSma I 1 1 r t <RCC0R0_P0l NTER (Qucucli.  idr-r)  CJ I ; 
RFG1N  ' ii'-  IcteRmal  lest" 

RE  COM  I F'O  I N T t R (Nock-)  rtmRt,  sma  I lest,  p,  rtmChild,  rightRtT,  nc  t jR  t niR  t , nfrglree, 
n x t 1 1 cc; 

INTEGER  t.,  sma  I I es  tKey; 

rtmRt  • QiieiicHc- ider : I C h i I d 1 [Q1 : s *-  QueueHeadertSizelQ] ; 

"Search  for  the  node  containing  the  smallest  key  in  the  queue." 

smallest  • rtmRt;  sma  I I estKey  *•  Key  (sma  I I est] : 
p «-  ISibl  i ng  t sma  I lest]  ; 

UHIL  E ISibl ing[p]  * NULL  _RL  CORD  DO  BEGIN 
IF  sum  I I os tKey  > Keylp]  THEN  BEGIN 

smallest  •-  |i;  smallestKey  <-  Key  [sma  I I est]  END; 
p - I Si  h I i nci  t|i) 

END; 

"Merge  the  offspring  of  the  smallest  node  with  the  rightmost  tree  in  the 
forest.  ciiiD  s the  rightmost  tree  contained  the  smallest." 

r t mCh  i < i • I f h i I d [ sma I I c s 1 1 ; 

IF  rtmChild  = NULL  JTECORD  THEN  BEGIN  "smallest  is  a B0. " 

"The  deletion  can  be  completed  now." 

IF  c J THIN 

D irile  irler ; IFhi  Id!  IQ]  «-  NULL  RECORD 
E I SI  i.IN 

O'  >:  tel  It  arlcr : ICh  i I cl ! IQI  *-■  ISibl ingtsmal lest] ; 

1 1 i b I i ng  [ I Ch  i I cl  [ I S i b I i ng  [sma  I I est]  ] ] <-  Q 
END 

END  " sma  I I rr  t i s a B0. " 

El  Sf  PI  GIN  "smallest  is  not  a B0. " 

"I  i’  i the  rightmost  child  of  the  smallest  node." 

WHILE  IChi Id [r tmChi Id]  * NULL_RECORD  DO 
r t mf  h i I cl  «-  I S i b I i ng  [ I Ch  i I cl  [r  t mCh  i Id]]; 

IF  smallest  = rtmRt  THEN  BEGIN  "smallest  is  the  rightmost  root." 

"The  deletion  can  be  completed  non." 

Qur-i  leHeador : ICh  i I cl 1 (QI  *-  rtmChild; 

I S i h I i ng  [ I Ch  i I cl  [sma  I lest]]  <-  IS  i b ling  [sma  I lest]  ; 

IF  IS i h I i ng (smal lest)  * 0 THEN 

I S 1 1.)  I i ng  ( I Ch  i I d I IS  i b I i ng  [sma  I lest)])  ► I Chi  I cl  [sma  I lest] 

ENCl  "smallest  is  the  rightmost  root." 

E I SC  BEGIN  "smallest  is  not  the  rightmost  root." 

"Got  up  for  the  merge." 

rightRtT  •-  I S i b I i rig  [ I Ch  i I d [sma  I lest]]; 

IS  i b ling  t IC.hi  I d tsma  I I est)  ] *-  NULL_RECORD;  "Mark  leftmost  child." 

IF  -CiDD(s)  THEN  BEGIN 

"The  rightmost  tree  is  not  a B0,  so  some  children  of  smallest  will 
be-  the  smallest  trees  in  the  new  forest." 
nciiR t niR t * r tmCh i Id; 

<-  */2\ 

UHIL  f -.ODD(s)  00  BEGIN 

rtmChild  ••  IS i b I i ng  [r  tmChi  I d) ; s <-  s/2  END; 
mrgTree  •-  IS i b I ing  [r tmChi Id] ; 

IF  rightRtT  « rtmRt  THEN 
r i ghtFtt  T * r tmCh  i I cl 
LI  SL  BEGIN 

ISibl ing [r tmChi Id!  *-  iSibl  ing  [rtmRt] ; 

I S i b I i ng  [ I Ch  i ! cl  1 1 S i b I i ng  (r  t mR  t ] ] ] «-  r t mCh  i I cl 
[ MD 
END 
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HI  BEGIN 

" It,,  i iyhtmost  tree  ir  a B0,  to  it  combines  with  all  of  the  children 
nf  smallest  to  for  in  the  replacement  tree." 

II  r i cil i tfl  t T * r I niR t THEN 
i iqhtRtT  < NUl  L RECORD 
I I Si  ftf  HIM 

newfltinFi’t  r I S i b I i ny  [r  tmR tJ  s 
I S 1 1:>  I i ny  [ IDi  i I cl  InruR  tmR  t) ) *-  Q 

I N[l; 

"I’ti  form  the  first  nr  i tie.  The  merge  of  EI0’ s is  handled  specially  in  order 
i I i inmate  a ter  t from  the  inner  loop." 

I I <|  1 1 i ■ . I'-i  i h I i rui  [r  t mCh  i I cl)  : 

II  he  i [i  1 1 ill  t ) > Keei  [r  twChi  Id)  THEN  rtmRt  *•  rtmChild; 

It  li  i I d ir  tmRtl  *-  rtmChild; 

I li.'; 

" C. • el)  1 1 e to  the  mer  ye.  " 

WM II  F mrylree  » Nl.fL  L_  RE  CORD  DO  BEGIN 
nxtlrei  > I S i bl  i ny  imr  yTr eel  ; 

II  KrqlrtmRt)  > Key  [mrylree]  THEN  rtinRt  « mryTree; 

I S i b I i ny  II  Chi  I d ImrgTroel  J *-  ICh  i I d ir  tniRt) ; 

I S i li  I i ny  1 1 Ch  i I d Ir  tniRt) ] •-  mrylree; 

ICh'Idtr  tmHt)  <-  mrylree; 
ini  c 1 1 r t‘C  •-  nx 1 1 r e e; 
f Nil;  ' 

"l  ink  the  tree  created  by  the  merge  into  the  forest." 

ISihl*  iy[rtniRtJ  •-  I i>  i h I i ny  isma  I I es  t ] ; 

IE  I 0 i b I i ny  I sma  I lest]  »•  0 THEN 

I $ i h I i nci  ( I Ch  i I cl  [ I S i h I i nq  [sma  I les  1 1 ) 1 «-  rtmRt; 

IF  r iqhtRtT  =-  NULE  JTEC  0RD~  TEIEN  BEGIN 
QueuoHcacler:  IChi  Id1  (CH  «-  rtmRt; 

I 0 i l.i  I i rici  i I Ch  i I cl  Ir  tmR  t ) ] <-  0; 

TNI' 

El.  SI  BEGIN 

U’ I'-iieHf  Cider  : I Eli  i I cl ! [CD  *■  newRtrnRt: 
i h I i nq  ir  i yhtRtTl  <■  rtmRt; 

I S i b I i ny  ( I [.hi  Id  (r  tmR  t ) ] ricjbtRtT 
1 N(  I 

ENLI  "smallest  is  not  the  rightmost  root." 

E NEl  "sma  I I erf  it  not  a [10. "; 

Glui  i jell.'  irir  r : S i ne  ECJ]  Queue  Header : S i ze  ill)  - 1; 

I S i h I i n' i isma  I I es  t ) *-  IChi  Idtsmal  lest)  •-  NULL_REC0RD; 
fft  TURN  I sma  I Inst) 

END  "Ele  I e teSma  I lest"; 


Rf  I OFi'I  i Rt  1 1 N 1 1 H ( Qt  it  ueHeader ) PRfJFEFJURE  Delete  (RErOF(D_POINTEFi  (Node)  x); 

BEGIN  " L>* • I e te" 

Fit  t LtRLl  PUIN1I  IMQueueHt  ader)  Q; 

RECORD  POINTER (Node)  p,  rtmRt,  ricjhtRtT,  leftRtT,  pN,  Fr,  Tr,  neuRtmFU,  mrgTroe, 
nx t 1 ref; 

FOnnt  NT  H(  ro  T denotcr.  the  tree  containing  x,  and  Tr  the  tree  uhich  replaces  T; 
RECORD. POINTF R (Node)  ARRAY  pa  tH  [1:181;  CCKtlENT  18  is  Igfmax  queue  sure)  + !• 
INTEGER  i,  s,  i Rave ; 

LAE'T  l (Tct  gef  oi  ests,  De  I e teRe  tur  n; 

"Climh  out  of  the  binomial  queue  to  reach  the  queue  header;  save  the  trail 
ot  nodes  visited  in  the  'path*  array." 

| . . x ; i * (I ; 

UtH  I F p =•  Nlll  t . RF  F ORD  DO  BF  GIN 

i - ill;  p.ithli]  i-  p;  p «-  iSiblingtpl  END; 

Q *-  p- 1 1 h [ 1 1 ; i *-  i - 1 ; 

s * Clin  ueHeaderiSize  ttJ) ; r tmRt  <-  QueueHeader : iCh i I d 1 (Q)  ; 

"Flou  chid  ue  get  to  the  queue  header?  There  are  two  possibilities;  either 
fiom  the  II  hi  Id  of  the  rightmost  root,  or  from  the  leftmost  root." 

IF  path  til  - I Ch i I d Tr t mR t ) THEN  BEGIN 

"x  i a non- root  node  in  the  rightmost  tree." 
r iqhfh'tT  - NULL_RECORD; 
leftRtT  ♦ 1 5 i b I i ng  Ir tmRt] ; 

I iN  4-  -tmRt 

END 

ELSE  BEGIN 

"Either  x is  the  root  of  the  rightmost  tree,  or  it  is  in  some  tree  other  than 
the  rightmost.  Locate  the  root  of  the  tree  containing  x. " 

WHILE  TRLIE  DO  BEGIN  "RootSearch" 

IF  i-?  i 0 THEN  Bf  GIN  "x  is  a root." 

"The  dismantling  of  the  tree  containing  x can  be  completed  non." 

I r f tR  tT  > I S i b I i nc|  fxl  ; 

iF  I fill  i Id  Fxl  ^ NULL  J. I CORD  TFIEN  BEGIN  "x  is  a B8. " 

"Ttii  deletion  can  ho  completed  now." 

II  s ■-  I T FIT N 

Hi  ii’iieFleader : I Chi  Id!  IQ]  *-  NULL_RECORD 
EIRE  BEGIN 

FJi ifuelleader : iChi  Id1  IQI  *■  leftRtT; 

I Ei  I h I i ng  1 1 Ch  i I d 1 1 e f tR  tTl  1 <-  Q 
END: 

GOIO  [le  I e t eRe t urn 
END  "x  is  a B0."; 

i i ght  Fit  T *-  I S i b I i ng  1 1 Ch  i I d [x]  ] ; IF  rightRtT  = Q TFIEN  ricjhtRtT  «-  NULL_RECORD; 
Fr  » lEhildlxl;  I S i b I i ng  [Fr]  <-  NHL  L__RE  CORO; 

WHILE  IChi  Id  [Fr]  x NULL_RECORD  00  Fr  *-  IS  i b I ing  [ ICh  i I cl  FFrl  1 ; 

GOTO  Her geForests 
F Nil  "x  is  a root."; 

IF  I Ch i I d (pa th  [ i 1 1 = pathFi-2)  THEN  DONE  "RootSearch"; 
i »-  i - 1 

END  "RontSenrch" ; 

"x  is  a non-root  node  in  some  tree  other  than  the  rightmost." 
pN  « pathtil; 

ricihtRtT  * pathli-ll;  leftRtT  *-  I S i b ling  IpNl  ; I *■  i -2 
END; ' 

"He  air  lure  to  dismantle  the  tree  containing  the  node  x;  x is  not  the 
root  of  this  tree,  since  that  special  case  was  handled  above. 

The  dismantling  proceeds  top  doun;  large  trees  are  generated  before  small 


crsfTZ ' 


! 


b 

* 


At  etch  step,  there  it-  a forest  of  trees 
1 1 Iti  to  I dryer,  in  hr.  There  is  also  a node 
i -t  of  t tie  tree  containing  x,  in  pN.  Each 

loner  level. 


Any 


tin 

path  node  cm  the  level  on  the  next 
thic  Inner  path  node  are  added  to  the  forests  then  a 
and  the  trees  to  the  right  of  the  loner  path  node  is 
path  node  becomes  pN,  and  the  process  repeats  on  the 
level  of  nude  x is  reached. 


already  saved,  linked  fiurn 
on  the  ’true’  path  from  x to 
step  begins  by  finding  the 
trees  to  the  left  of 
tree  formed  from  pN 
added.  Then  the  loner 
new  I eve  I until  the 


Utii  n tl,i  d i 'i  i.int  I i rig  begins,  pN  is  the  root  of  the  tree  containing  x 
hi  I i i-  .hi  ind.-x  in  path  such  that  IChildtpN]  - pathlij." 

Fr  • Null  FirC'ORO; 

UHIIF  Th'Uf  LIU  Eft  GIN  "DounLoop" 
i S i ve  <-  i : 

Uililf  TRUE  [TH  BEGIN  "Rightl.oop" 

If  i 0 THEN  DfiNE  "UounLoop": 

II  IChi I d [path [ i 1 } = pathIi-21  THEN  DONE  "RightLoop"; 
i * i - ] 

E I JIT  "fi  i nli  U oop" : 

II  id  ,ve  - i THEN  01  GIN 

I Ei  i l.i  I i ng  (pa  th  I i Save!  ] «-  Fr;  Fr  • pa  th  I i +1 J END; 

IChildtpN]  * pathti  II;  iSibTingLpNJ  *•  Fr;  Fr  *-  pN; 
pM  • path  I i ] ; i • i-2 

f NO  " [ h mi  il  oop  " ; 

IF  , ,v.  x ] THIN  BEGIN 

I E>  i h I i no  (pa  th  t i Save]  ) *-  Fr;  Fr  *-  path[21  END; 

I - h I i i n i IpNJ  «-  f r ; Fi  <-  | if J ; 

IE  T-drilxJ  = NHLL_RE  CORD  THEN  IChildtpN]  - NULL  .RECORD 
ELSE  Of  GIN 

IChildtpN]  ‘ 1 S i b I i rig  [ I Ch  i I Cl  Lx]  ] ; 

IS  i b I i nr;  [ iC.hi  ! rl  [x]  ] * Fr;  Fr  «-  I Ch  i I ct  Ex]  t 

UHHF  I C hi  i I cl  (Frl  * NULL  RECORD  DO  Fr  - I S i b I i ng  t iChi  I d LFr]  ] 

END; 


Nor  gc  f or  c-  t s : 


"The  variables  passed  from  above  are  rtiuRt,  r ightRtT,  leftRtT,  Fr,  Q,  and  s." 

IF  r ightRtT  Nl  ll.L.RLC  ORD  THEN  BEGIN  "the  rightmost  tree  uas  dismantled." 

"The  deletion  can  be  completed  non." 

Cl  I jr-ijrT  Ir.irpi  ; IChi  Id1  IQ!  *-  Fr  ; 

WHILE  IS  i (j  I i ng  [Fr]  NULL.FiLCORD  DO  BEGIN 

I Ei  i b I i ny  [ I Ch  i I d [ IS  i b I i ng  [Fr]  ] I «-  Fr  ; Fr  <-  I S i b I i ng  [Fr  ] END; 

I Si  b I i ny  IF  r]  * leftRtT;  If  leftRtT  * Q THEN  ISibl  ing  [ IChi  Id  [I  ef  tRt  T]  ] «-  Fr 
EN[i  " Hi.-  r i ght most  tree  uas  dismantled." 

LISE  E4GIN  "a  non- r i gh  t most  tree  uas  dismantled." 

"Set  up  to  merge  Fr  uitli  the  rightmost  tree." 

T r < r t mR  t ; 

If  -.[il lilts)  THEN  BEGIN 

"The  gnrue  size  is  even  before  the  deletion,  so  some  trees  in  Tr’ 
in  I I niiive  up  to  become  the  smallest  trees  in  the  new  forest." 
ruufltmRt  * Fr; 
s • s/Z’j 

uhii  f -.rmcKs)  no  begin 

I S i b I i ng  1 1 Ch  i Id  I IS  i b I i ng  [Frl  ] J *-  Fr;  Fr  ► ISibl  ingtFr] ; 

' . END; 

nngTreo  •-  I S i b I i ng  IF  r ] ; 

If  r ightRtT  = rtmFt  THEN 
r i yh  tfl  t T • Fr 


88 


' • •- ' f 


i i sr  rti;iN 

IE>  i h I i ng  [Fr]  *-  iSibl ing (rtmRt) ; 

I S i I ' I i ng  [ I Ch  i I cl  1 1 S i b I i ng  [r  tmRtl  ] ] *-  Fr 

I N!  I 

E ND 

FI  RE  fil  l. IN 

"lht  queue  sire  is  odd,  so  all  children  of  the  removed  root  nil  I he  used 
to  make  the  replacement. " 

II  r i <|h  f Iff  1 - r t inf  t 1 1 II  N 

i i til, tilt T . NULL  RECORD 

I l M I'LMN 

rti  iiR  tinflt  *-  ISi  b I i ng  lr  tmR  t)  ; 

I R i h I mq  [ ICh  i I d [neiifl  tmR t ] ] *■  Q 
FNIl; 

"I'irfciim  the  first  merge.  The  merge  of  B8’ s is  handled  specially  in  order 
speed  up  ttie  i nnrr  loop." 
nirriTree  - I S i l)  I i rii  i (F  r ] : 

II  kh'ii  1 1 1 ) > Key  [F  r)  IIILN 
Tr  ••  ft; 

l(  lr  Llllr]  *■  E r ; 

[ Nil; 

"Complete  the  merge." 

HI  1 1 L f mrglrer  * NULL  . RL  LOuD  DO  BEGIN 
i ix  t Tree  *-  IS i b I i ng  [mrgTree] ; 

If  Ken  [lr]  > Keylmrglrrr]  THEN  Tr  « mrgTree; 

1 1 i b I i nci  [ ICh  i I d [mrgtrecl  ] *-  IChildlTr); 

1C- i hi  i ny  [ IChi  I d [TrJ  1 *-  mrgTree; 

ICh  i I d [ Tr ] *"  mrgTree; 

. nn  gTrcc  *-  nxtTree; 

» FUri; 

"The  merge  is  complete;  link  the  neu  tree  Tr  into  the  forest." 

I Ci  i h I i no  [1  r ] • leftNtT;  IF  leftRtT  * Q THEN  IS  i b I i ng  [ ICh  i I d [ I ef  t R t T]  ] <-  Tr; 

If  rightRtT  = NULL. RECORD  THEN  BEGIN 
rjiitiir-Heailer : I Chi  Id!  [Ql  <-  lr; 

I S i h I i ny  [ I Ch  i I cl  [Tr  ] 1 *-  Q 
FND 

El SE  BEGIN 

Queuel  leader : I Chi  Id1  [Ql  *-  neuRtmRt; 

I R i b I i ng  [r  i qh tR t T]  *-  Tr  ; I S i b I i ng  [ ICh  i I d [Tr]  ] «-  rightRtT 

END 

END  "a  non  rightmost  tree  uas  dismantled."; 

Cle  I e teRe  turn: 

Queuel  leader : G i re  [Q]  *-  Queuelleader : Si  2e  [Q]  - 1; 

ISihlinyfx]  I Ch  i I cl  lx)  *-  Nl  ILL_RECORD; 

RE  TURN (Q) 

END  "Delete"; 


f t i|  i I - I If  • 1 1 ii  i I flf  r I lfi'0  EH  I N 1 ( If  ( Q*  it-ueHt  i • ,r  I T , Cj  I ; 

EU  H 1 N "lli  1 1 on" 

III  i i 1 I "C> N II  II  (Nodi  I ARRAY  F'k  1 1 : 3)  ; 

I N 1 1 I •(  I i i : 

c Of  H I!  f.  fin  i!  .i  ‘ lii'k  of  [Ik  trees  uhii  i accumulated  for  each  r t toe  of 

1 1 i I'll  f ii.il".  1 t I ' " III  C I 'I  I I • • t ' I.  . jf  I Bk  [1  i . Tfie  I fi  t r • jrr  i 

i 1 1 1 i > | k ' 1 1 1 ’ i i , i . i . , it  i ■ 1 1 * 1 ii  t • i . i o t 1 1 en  s in  the  ; t a-.  > . ; 

R[  T'l  if  ,|  l I 1 1 1 N [ L ( I (No  t*  I r F , t N,  r F , duntnn  i; 

EEifllil  N:  if  |'i'int‘-  t tin  I Jit  i ir  t ti  ei  in  the  r t il  t forest  uhich  hue  Peon 

t|i  i it  i . 1 1 1 1 1.  ; 

INllU  II  * T . <U; 

.1  . i j i ii  I If  Tit  let  ; G i ! 1] ; r 1 * Queuet  it  »>  it-*  : ll.hi  Id1  IT1  $ 

• (J  . Ui  • hi le  r let  : S t L'v  1 j i ; rU  »-  Queuct  le  > let  : t C h i l d 1 FQ]  ; 

c 1 1 tiiiru . j i Ml  U Hi  GORD  (fr  lie)  ; 
rf  * iluriiiiiu; 

i 0 ; 

i I ii  inii.ii  i|  . ii  Id  i t i on  it  I got  t t hm.  " 

'Flu  li'  t > • • at  « h.vuiK.t  specially  te  t • vc  tests  from  the  inner  loop." 

IF  f K t[  i ( ' Ii  lllf  N Bl  1-IIJ 

i • ill:  (ik  [ i ] • r i : r I » IS  i b I • n i It  1 J END; 

If  OLUM'.Q)  THIN  BEGIN 

i . i -*  1 ; RE.  ( i ] •-  r t. ; t ij  » I Bib  lino  l Ml  END: 

IF  i 1 THf  N RFGIN 

I i b I i nn  !r  f ] • Elk.  (1 1 ; if  * F'k  [ 1 ] ; i • 0 END; 

IF  i I'  IMF  N EH  I. IN 

If  Kr  1 1 [Bk  till  > KeuFBMM)  THEN  Bk [11  ••  Fk  ID  ; 

t i id  tf'k  Fill  • Bk  12) : 

i run,  * ’ 

si  . M/2;  ' 4 • MJ/2; 

"Ti.*  (|.  ii(  i .-|  I ■.  1 1 1 1 . 


il  F 

(M  iv 

(ft  V 

(sQ  i-  0)  F 

1 BEGIN 

IF 

HI  HUM) 

Till  N 

BEGIN 

i 

• iM: 

(Ik  F 

1 1 - r T ; r 

T *-  tSibl inylrTJ 

END; 

IE 

ruin  (mi 

HIF  N 

BEGIN 

j 

• i -t  1 : 

(Ik  [ 

il  • r Cj ; t 

0 * 1 S i l.i  1 i ti- 1 IrQ) 

END; 

IE 

l i - 1 ) 

1 i 

= Cl)  THEN 

BEGIN 

1 

S i h 1 mo 

Ft  f I • 

Bk  lli;  1 

S i b 1 i ny  l ICn  i 1 cl  IF'k 

Fill] 

t f • F'k  F i ] ; i * i - 1 
F Nil; 

If  i 2 1HLN  BEGIN 


IE  K*  1 1 I(ik  1 1 1 1 > KtylBkF?)]  THEN  Bk  11)  ••  Bk  F2I  : 
i '■  i h I i iii  i [ IL  It  i I d FBk  [2 1 1 1 • I C h i I d ll'k  [ 1 1 1 ; 

. 1 1:>  I i nn  [ I Chi  Id  (Elf  FI  1 1 1 • Bk  [21  ; 

" lli  IrllUkFin  - Bk  12) : 

i • 1 

END; 

T • ■ 1/2;  r-fj  - sQ/2 

F NN; 

"Handle  a catry  off  the  encl,  if  present.” 

IE  i 1 IEIFN  BFGIN 
I r 1 1 1 1 i nc|  [rf  J • F'k  [ 1 I ; 

I'  ■ i h I t no  [ 1 1 h i Id  ttlk  [1 J ] I < if; 
tf  • Ilk  1 1 1 
FEJLi; 

”1  ink  the  r<-  ijlt  into  Q . and  clear  out  T." 

I S i h I i rii|  (r  E ] • Cl; 

Nor  tt  Hi  ade  r ; I C.li  i I d ! ICil  *-  I S i b I t ng  (dumniu) ; 


* 2S  l» 


4 7 ■ ' 


it'ir!1'?  ,'mint  ,V1r  tl,Jmn,y  nodc  can  he  explicitly  deallocated  to  save  C-C’s 
le  It  In  Id  lUiir  ueHeaderi  IChi  Id' (Q) ) * NULl_RECORD  THCN 
IS  i M i ncj  ( I Chi  Id  fQueueHeader:  ICh  i Id1  [Q]  J ] - Q; 

Queue  1 1<  ade  r : ' > i n • IQ)  Queue  I leader : S i ze  [I]  + QueueHeader tSi ze tai • 

Queuell,  ader:  IC.hi  Id!  (T)  <-  Nl ILL _RE CORD: 

Queue  I le  . tder  : S i ze  U J •-  0; 

END  "Union": 


FAIL  Imi'leme:!-.  at  i(  ns. 


.1  ' . mlaj  "■  ting  Si  rdM  w-.  R . 


TIILF  BQ 

•MR  1 1 L Binomial  queue  priority  queue  routines  using  structuri  B. 
ENTRY  INS_BQ,CiCl  BG 

: F'eq  i sters: 

IFAll  R.  ] ; SA I L result  register  for  typed  procedures. 

ISAILLp*17  ; SAIL  regular  PLiL. 


: Node  F i e 1 d : 


II  MUST*  • 0 
IBI7E-  1 


II  CHILD*  • 0 
II  MM  INC.  • 0 

IFF  V*  • 1 


Header  node: 

Pointer  to  root  of  leftmost  tree  in  forest. 

Fulluord  integer  count  of  numPer  of  elements  in  queue. 

Queue  element  trinomial  queue)  node: 

Pointer  to  leftmost  child  of  this  node  (right  half). 
Pointer  to  next  sib  to  left  of  this  node  (left  half). 
If  no  left  sib,  then  points  to  rightmost  S'h  in  t*  M. 
Full uord  integer  or  real  key  (i.e.,  node  pi  in  ity). 


1 1 NS_HF  l : HAL  T 
iPLL  Ur  L:'HAl  1 


;Trap  handlers: 

jHere  on  insertion  into  queue  with  SIZE  < 0. 
;Here  on  deletion  from  queue  with  SIZE  s 0. 


FAIL  Implement ations . 


o 


2.1  Binomial  Queue  using  Structure  R . 


Tiur  m 

MIB11L  Binomial  queue  priority  queue  routines  usiny  structure  H. 
LN1RY  I NS_BQ,  DLL..DQ 


4-SA 1 1 F(-  J 
ASAILJV17 


: Fieri  i s ter  s: 

iSAIl.  result  register  for  typed  procedures. 
:SAIL  reyular  PUL. 


; Node  F i e I ds: 


Al  MUST-  0 
AS  1 7E-  J 


Al  CHILD-  - 0 
•II  SIBLINC--0 

AMY-  I 


: Header  norlc: 

;Pointer  to  root  of  leftmost  tree  in  forest. 
jFulluord  integer  count  of  number  of  elements  in  queue. 

: Queue  element  (binomial  queue)  node: 

•.Pointer  to  leftmost  child  of  this  node  (right  half). 

: Pointer  to  next  sib  to  left  of  this  node  (left  half). 

: I f no  left  sib,  then  points  to  rightmost  sib  instead. 

; Fu  ! I (tore!  integer  or  real  key  ( i . e. . node  prior  ity). 


AINS.UF  l : HAL  T 
ADELJjr  L HAL  T 


;Trap  handlers: 

;Flere  on  insertion  into  queue  with  SIZE  < 0. 
iHere  on  deletion  from  queue  with  SIZE  < 0. 


HI  GIN 

INS.BQ 

: B i nom  i a 1 ci 

10- 

0 

IK 

1 

(J- 

2 

X< 

3 

1 MR- 

t\ 

: L MOST  ROOT 

HMR- 

r. 

: RMOST  ROOT 

NX1R«- 

G 

•.NEXT  ROOT 

procedure  1 NSER1 (ref erence (NOPE ) X; 


TINS  FU’J : HIT \7 

0. -1 (SAIL  PI 

reference  (QHEUEHEAElE 

ai  isr. 

S.SIZE  (Cl) 

S - SIZE (Q)  - SIZE(Q)  + 1 

It  ,"..T 

IMS  PEL 

if  S < 0 then  ERROR  endif 

III  V[ 

l nP, LMOST (PI 

LMOST  ROOT  - LMOST (Q) 

III  R/ 
H1 17 

I'MR.l  SII'l  ING(LMR) ; RflOST  ROOT  - LSI BL I NG (LMOST  ROOT) 
X.-r<SAJL  PI 

si  izn 

1 GHC 

LSI DL l NG ( X 1 
S.-I 

:LCH1L0(X)  NIL: 

Jl  If  If  L 

SI .h  DONE 

if  even(S)  then  (Handle  first  werqe 

III  RZ 
Mi  IVE 

NXTR.LSI  BL  INC.  (RflR) : NEXT  ROOT  . LSIBi  I NG  (RflOST  ROOT) 
TO.KEY(X) 

C AML  F 

TO.  KE  Y (F.TIR) 

if  KEY(X)  > KEY (RMOST_ROOT ) 

E XCH 

X , RMR 

then  X •*  RMOST  ROOT  endif 

WRRfl 

RMR.LCHlLOtX) 

LC.HILO (X)  - RMOST  ROOT 

nnvsn 

RMR. LSI  BEING (RMR 

):  LSIBL ING (RMOST  ROOT)  - RMOST  ROOT; 

MOVE  | 

RMR. (NXTR) 

RMOST  ROOT  - NEXT  ROOT 

1 SHC 

S.-J 

S - S/2 

ji  ini'L 

Sl.M  DONE 

1 oop  uhi le  even (S) : 

M_LOOP: 

HI  RZ 
III  IVE 

NXTR, LSI BL 1 NG (RMR) : NEXT  ROOT  LSI BL 1 NG (RMOST  ROOT) 

TO, KEY (X) 

C.AI1LE 

TO. KEY (RMR) 

if  KEY  (X)  > KEY (RMOST_ROOT) 

r xch 

X.RMR 

then  X •*  RMOST  ROOT  endif 

HRR7 

TI.LCHILD(X) 

T 1 ^ LCHILO(X) 

III  iRM 

RI1R.LCH1L0  (X) 

LCHILD(X)  - RMOST  ROOT 

III  RZ 

T0.LS1BL ING (T 1 ) 

TO  - LSI BL 1 NG l T 1 > 

URL  M 

RMR.LSIBL ING(Tl) 

LSIBLING(TI)  - RMOST  ROOT 

HI.'LM 

TO. LSI  BEING (RMR) 

LSI  BUNG  (RMOST  ROOT)  e TO 

MCIVE  I 

RMR, (NXTR) 

RMOST  ROOT  - NEXT  ROOT 

L SHE 

S.-l 

S - S/2 

JUMPGE 

SI , MJ.OOP 

repeat 
endi f ; 

M_DONE : 

Jl  IMF’N 

S. UNKIN 

i f S = 1 then 

MLIVEH 

X, LMOST (0) 

LMOST (Q)  - X: 

HRl.fi 

X.LSIBLING(X) 

LSI BL I NG (X)  - X 

JRST 

EXIT 

e 1 se 

LINK  IN: 

HRLfl 

X.LSIBLING(LMR) 

LS I BL 1 NG (LMOST  ROOT)  - X; 

URL  M 

RMR.LSIBLING(X) 

LSI BL ING (X)  - RMOST _ROOT 
end  i f 

EXIT: 

SLID 

JRST 

SAIL  P.  (3. .31 
p>3  (SAIL  P) 

LUND 

INS  BQ 

end  (INSERT) 
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P(  GIN 

Dt  L_BU 

jBinomial  c|ueue 

HI. 

0 

1J. 

n 

(J. 

3 

i riii. 

A 

triOST  ROOT 

f <riR« 

5 

RflOST  ROUT 

NiiriR. 

f. 

NLU  R1I10ST  ROOT 

rir- 

7 

MERGE  CHILD 

RPRFD. 

10 

RESULT  PREO 

PI  1CV 

11 

RflOST  _CH  I LD 

r 

13 

si. 

S+l 

HI  SI  KE  Y-T0 

IT  JED. 

T 1 

SI  ICCV 

MC 

Nl.v 

S 

NEXT_CHL1D 

?DEL_BCI:  HKRZ  Q. -1  (SAIL_P) 


SOSGE 

S.SIZE (Q) 

iS  - SIZE (Q ) - 

' JRST 

DEL  UIL 

; i f S < 0 then 

MOVE 

LMR, LMOST  tQl 

-.LMOST. ROOT  - 

III  RZ 

RMR.LSIBLING(LMR)  ;RMOST.  ROOT  .■ 

CAIN 

RMR, (LMR) 

; i f LMOST. ROOT 

reference (NONE)  procedure  DeleteSmal lest 

(reference  (QUEUEHEADER)  Q) 
SIZE (Ql  - Is 


uhose  root 
Remove  the 
chi  I clren. 


JRST 


(ROVE  I 
HRRZ 
MOVEM 
JRST 


LSIBL1NC>(LM0ST_R00T) ; 

- RflOST  _R00T  then 

Uhe  forest  consists  of  a single  tree, 
contains  the  best  key  in  the  forest, 
root,  making  the  new  forest  from  its 
and  we’re  done.  I 
SAIL  R. (LMR) ;DEL_BQ  - LM0ST_R00T; 

T0.  LCHI LD  (LfIR) 

T0. LMOST (Q) ; LMOST (Q)  r LCHI LD (LM0ST_R00T ) 

EXIT] 

' se 

Uhe  forest  consists  of  more  than  one  tree: 
search  the  roots  of  these  trees  for  the  best  key 
Scan  the  forest  from  right  to  left,  but  use  the 
best  key  in  the  leftmost  tree  as  an  estimate  of 
the  best  key  in  the  forest.) 


NFU  BE 


S LOOP 


S DONE: 


HLLM 

RMR, LS IDLING (LMR) ; 

LSIBLING (LMOST  ROOT)  .-  NIL; 

MOVE 

BEST  KEY. KEY (LMR); 

BCST  KEY  - KEY (LMOST  ROOT); 

MOVE  1 

F'RED.  (LMR)  : 

PREO  .-  LMOST  ROOT; 

MOVE  I 

SIICC,  (RMR)  j 

SUCC  <-  RM0ST_R00T ; 

JRST 

S LOOP 

MOVE 

HI  ST  KEY.KFY (SDCC ) 

MOVE  I 

RI'RECi,  (f'REDI 

MOVE  I 

PRCD, (SDCC) 

111  RZ 

SI  ICC. LSI  Ell  I NG  (SUCC) 

JMMPE 

SI  ICC,  S DONC  : 

1 oop  until  SUCC  = NIL: 

CAML 

PEST  KEY, KEY (SDCC) ; 

if  BEST  KEY  > KEY (SUCC) 

JRST 

NT W.BST  ; 

then  BEST  KEY  KEY (SUCC): 

• 

« 

RESULT .PREO  - PREO 

• 

endi f ; 

MOVE  I 

F'RED,  (SDCC)  : 

PREO  - SUCC; 

Ml  RZ 

S' ICC,  LSI  BUNG  (SUCC) 

; SUCC  ^ LSIBLING(SUCC) 

.11  IMF  'N 

SI  ICC,  S LOOP  ; 

repeat ; 

1 11  RZ 

SAIL  R.  1 SIBLING (RPREOI ;C)EL.BQ  - LS IDLING (RESULT_rRED) ; 

l SHE 

S,-l 

Jl  111!  'N 

SAIL_R.NOT_RM  ; 

if  DEL_BQ  = NIL  then 

» 

(The  best  key  is  in  the  root  of  the 

tree  in  the  forest.  If  this  root 


sma I lest 
has  ch  i I clren, 


ft 
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L 


HOVE  i 

SAIL  R. (RMR) 

JUMPL 

S1.SN.BE ST 

SO  BEST: III  RZ 

TP. L SI Bl  ING (SAIL  ’ 

HRLH 

10.LSIBI  ING(LtlR) 

JRST 

EXIT 

SN  BEST : HRRZ 

7 1 . LCHILO (SAIL  Ri 

1 II  RZ 

T 0. LSI BL I NG ( T 1 j 

HlfLN 

TO, LSIBLING (LNR) 

% 

HI  RZ 

T0,LS1BLING(SAIL 

HRl  N 

10.LSIBI ING(Tl) 

JRST 

EXIT 

V 

NOT_RN: 

1 

♦ 

% 

HRRZ 

1 1 , LCHI l 0 (SAIL  R) 

HLRZ 

RNC.LSIBLING(Tl) 

- 

HI  LN 

T 1 .LSI BL I NG ( T 1 ) 

1 

junrGF 

SI. S.  EVEN 

i 

S ODD;  HOVE I 

NRI1R,  (RNC) 

1 MIC 

S.-l 

jiini’GE 

Sl.C  DONE 

\ 

C LOOP:  HLRZ 

RNC,  LSI  BUNG  (RNC) 

l SHC 

S.-l 

Jl  IHf'L 

Sl.C  LOOP 

C_DONE : HLRZ 

nc. LSIBLING (RNC) 

CAIN 

RPREO, (RNR) 

then  they  move  up  to  become  the  roots  of  the 
smallest  trees  in  the  forest,  and  we're  done. I 
DEL.BQ  - RNOSTJfOOT; 
if  events)  then 

(The  best  key  is  in  an  S0  tree  (uhich  is 
distinct  from  the  leftmost  tree,)  Remove 
the  SO  and  fix  link  from  the  leftmost  tree.) 


LS l BL I NG (Lf10ST_R00T ) - (.SIBLING  (DEL.  BQ) 
e I se 

Hhe  best  key  has  children.  Link  them  inti 
the  riyht  of  the  forest.) 


IHOVEl  RPREO, (RNC) ; 
JRST  n LOOP)  : 


TO.LSIBLING(RnR) 
T0.LS1BL INGtRUC) 
N LOOP 


EVEN:  HI  R 7 
CAIN 


NRMR.LSIBl ING(RMR) ; 
RPREO. (RMR)  j 


LS  I BL  I NG  (Lf10ST_R00T ) *-LS  I BL  I NG  (LCH I LD  ( DEL_BO ) ) 
LSI  BUNG  (LCHILO  (OEL  BQ) ) - LSIBLINGtOF.L  BQ) ; 


LSIBLING(LCHILD(DEL_BQ> ) - LSIBL1NG(DEL_BQ)  : 

end  i f 
I se 

(The  best  key  is  in  the  root  of  some  tree  other 
than  the  rightmost  in  the  forest.  Children  of 
this  root  which  are  smaller  than  the  rightmost 
tree  will  move  up  into  the  forest;  the  other 
children  will  combine  with  the  rightmost  tree 
to  form  a replacement  tree. I 


RMOST_CHILD  - LS I BL I NG (LCH I LD (DEL_BQ ) ) ; 

(Nark  end  of  chi  I clren- 1 i st . ) 

LSI BL I NG (LCHILO (DEL_BU ) ) - NIL; 
if  odd(S)  then 

(Some,  but  not  all,  children  of  best  root 
will  move  up  to  be  roots  in  the  forest.) 
NEU_RTf10ST_R00T  - RNOST _CH1L0; 

S - S/2; 

I oop  wh i I e odd (S) : 

RNOST  CHILO  - LSIBLING (RNOST  CHILD) ; 

S - S/2 
repeat ; 

NERGE.  CHILD  - LSI BL  I NG (RNOST. CHI LD)  ; 

(Now  HNCIST_CHILD  is  really  the  leftmost 
which  will  move  up.  NERGE_CHILD  is  the 
rightmost  child  which  will  participate  in 
the  merge  to  produce  a replacement  tree. I 
if  RESULT_FREO  = RN0ST_R00T  then 

(LSIBLING  link  from  RNOST. CHILD  is  same 
as  LSIBLING  link  to  replacement  tree. I 
RESULT _PRED  - RNOST _CH1LD 
e I se 

(Link  children  into  forest  now. I 
LSIBLING (RNOST _CHILD>  •- 

LSI  BL  I NG  (RflCIS  T_RGnT  ) 

endi  f 
e I se 

(The  rightmost  tree  in  the  forest  is  an  S0. 
This  will  combine  with  all  chi  I clren  of  the 
best  root  to  produce  the  replacement  tree. I 
NFU  R TNOS T ROOT  - LSIBLING (ROOM  ROOT); 
if  RESULT_PRED  - RIlOST.RCinT  then 

(The  replacement  tree  will  b<  the  rightmost 
in  the  new  forest,  so  she  LSIBLING  link 
from  the  leftmost  root  will  be  the  LSIBLING 
link  to  the  replacement  tree. I 
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M LOOP: 


R_LM: 


R_N_LM: 


EXIT: 


Ml  IVL  I 

RRREP.0  : 

RFSULT_PREO  *-  NIL 

end i < ; 

(The  merger  of  tuo  S0' s is  a special  case 

hand  1 ed  here. 1 

III  RZ 

MC . LSI DL  INC. (RMD  ! 

MERGE  ..CHILD  - l SIBLING  (RflOST.  CHILD) ; 

niivf 

10. KEY (RMR) 

("AMI  F 

TH,KEY(RMC)  : 

if  kf y( Finos T.nnriT)  > key (rmqgt  child) 

( XCII 

RMR.RMC  ; 

then  RMCIST  ROOT  <•  RFIOST  CHILD  cndif; 

HI  IBM 

HMC.LCHILFHRMR)  ; 

L T H 1 L f l (RMC)ST*  ROOT  ) - RFIOST  Dll  l.M; 

Ml  IVSM 

RMC.LSIBLING(RMC) ; 

LSI  BL  1 FIG  (RMOST  CHILD)  RFIOST  CHILD; 

l .CHILn (RMOST.CHILD)  - NIL; 

end i f ; 

INou  finish  the  merge.  1 

JUMT'E 

MR.M  DONE  ! 

loop  unt i 1 MERGE  CHILD  = NIL: 

HI  RZ 

NC, LSIBL 1NG(MC)  ; 

NEXT. CHILD  ♦-  LSIBLING(f1ERGE_CH!LD)  ; 

MCIVL 

T0.KEY (RMR) 

CAMLE 

10, KEY (MC)  : 

if  KEY (RMOST  ROOT)  > KEY (MERGE  CHILD) 

F XCH 

RMR, MC  ; 

then  RMOST  ROOT  ~ MERGE  CHILD  endif; 

IIIIRZ 

Tl.LCMILD(RMR)  ; 

1)  • LCHILD (RMOST  ROOT); 

iiriRfi 

MC.LCHILD(RMR)  : 

LCHI LD (RMOST  ROOT)  MERGE  CHILD; 

HI  RZ 

T0.LSIBLINGU1)  ; 

TO  - LSIBL ING(Tl); 

IIIILM 

MC.LS1DL ING (T 1 ) : 

LS I DL I NG ( T 1 ) - MERGE  CHILD; 

HRLM 

T0.LSIBL ING(MC)  ; 

LSI  FILING  (MERGE  CHILD)  - T 0; 

Ml  IVE  I 

MC,  (NO 

MERGE_CHILD  - NEXTJZHILO 

JUMF'N 

MC , M_L  OOP  : 

repeat; 

(Its  time  to  tie  up  the  loose  ends. . . 1 

C A I E 

SAIL  F(.  (LMR)  ! 

if  DEL_BQ  ■=  LMOST  J-IOOT 

JRST 

R N LM  : 

then 

III  IVFM 

RMR. L MOST (Q)  ; 

l MOST (0)  RMOST  ROOT; 

Jl  1111  'N 

RPRED..43  i 

if  RESULT  PRED  = NIL 

URL  M 

RMR, LSI BLINC.  (RMR)  i 

then  LSIBL I NG (RM0ST_R00T ) - RMClSTJtOOT. 

JRST 

EXIT  ; 

e 1 se 

HRLM 

NRMR,  LSI  BUNG  (RMR): 

LSIBL ING (RMOST  ROOT)  - NEU  RTMOST  ROOT; 

IIRLM 

RMR,  LS I BL I NC.  (RF’RFD) ; 

LSIBLING(RE5ULT_PRED)  e RMOST.  ROOT 

JRST 

EXIT  : 

end  i f 

♦ 

e 1 se 

111  RZ 

T0, LSI  BEING (SAIL  R) 

HRi  n 

10,1  SI Bl ING (RMR): 

LSIBL ING (RMOST  ROOT)  - LSIBL ING (DEL  BQ) ; 

JLIMPN 

HI 'RED,.  4 3 i 

if  RESULT  PREO  - NIL 

HRLM 

RMR.LSIBLING(LMR): 

then  L 1 SBL I NG (LMOST_ROOT ) - F(MOST_ROOT 

JRST 

EXIT  : 

e 1 se 

HRLM 

RMR.LSIBUNGIRPRED); 

LSIBL  ING (RESULT  PRED)  RMOST  ROOT; 

HRLM 

NRMR , L S 1 BL I NG (LMR ) ; 

L SI  BL  1 NG  (LMOST_ROOT ) *-NE U_R T MOS T _ROO T 

; end i f 

! end i f 
: end i f 

; end i f ; 

SFTZM  LSI  BUNG  (SAIL  R)  ;LSIBLING(DEL_BQ)  «-  LCHILD(DEL_BQ)  - NIL; 
SUB  SA1L_P,  12..2J 

JRST  *2 (SAIL  PI 
BIND  DEL  BQ 


; end  (DFLJ3QI  ; 


2,2  Leftist  Tree 


* 


\ 


i 

f 


TITLE  LT 

SUBTTL  Leftist  tree  priority  queue  routines. 

ENTRY  IN5.LT.DEL.  LI 

iRcgi sters: 

4SAIL.FP1  : SA  i 1 result  register  for  typed  procedures. 

4SAI 7 ;SAIL  reyular  PUL. 


i Node  F i e I ds: 

; Header  node: 

4K00T *♦-  0 jPointer  to  root  of  leftist  tree. 

4SIZE**  1 jPulltiord  integer  count  of  number  of  elements  in  queue. 

; Queue  element  ( I ef t i st- tree)  node: 

; Length  of  shortest  (rightest)  path  from  this  node  to  NIL. 
: Pointer  to  left  child  of  this  node  (left  half). 

;F’ointer  to  right  child  of  this  node  (right  half). 
jFulluord  integer  or  real  key  (i.e.,  node  priority). 

jTrap  handlers: 

4 1 NS_ UF L : HAL  T ;Hore  on  insertion  into  queue  with  SIZE  < 0. 

40EL_UF  L:HAl_T  ;Here  on  deletion  from  queue  with  SIZE  < 0. 


4.DI ST-  * 0 
41  FFT*-«-  1 
4RICFIT— 1 
4KE  Y<  <•  2 


; Leftist  tree  insertion  and  deletion. 

[Registers  used  for  linkage  with  )1RG_LT 
i by  I NS_L T . DLL_LT, 


HI  GIN  IIIIG.LT 

UltlMENT  » Procedure  to  merge  two  leftist  trees.  Called  lay  JSP  N,nHG_LT, 
with  the  trees  to  he  merged  in  PI  and  Q L ; returns  with  result  tree  in  PI. 
This  procedure  uses  AC  D 1 ST  to  eliminate  special  checks  for  NIL  in  the 
rebalancing  phase;  thus  LUST  should  not  conflict  with  ACs  which  the  caller 
expects  to  be  preserved:  SAIL_P,  SAiL_R,  Q,  and  N.  e> 

N.  5 

Tie  G 

K<~  T 1 

D«-  7 

TMRG  LT:  ; ref  erence  (NCIOE)  procedure  MRG.LT 

; (ref erence (NODE ) P,Q); 

; IThe  "r  i ghtmerge"  phase  merges  the  rightmost  paths 
;of  P ami  0 into  a single  path,  preserving  the 
: property  that  keys  decrease  from  the  root  toward 
: the  leaves.  Since  the  next  phase  will  want  to 
; traverse  this  path  from  the  leaves  toward  the  root, 
; the  path  is  linked  upward,  using  the  RIGHT  field. 

; A t the  end  of  this  phase,  R points  to  the  lowest 
; node  on  the  new  path,  and  P contains  a "leftover" 

; tree  which  will  become  a child  of  R. I 


• 

MOVE  1 

R,  0 

R - NIL; 

JR3T 

ONI  OOP 

1 oop  un  t i 1 ON  I L or  PNIL: 

□SMALL : 

HftHZ 

T1 .RIGHT (Q1 ) 

i 

1 IRRM 

R, RIGHT  101 1 

i 

MOVE  I 

R.  (01) 

MOVE  I 

01 . (Tl) 

% 

DNLOOP: 

JHMPE 

Ql.QNIL 

if  Q = NIL  then  QNIL  end  if 

\ 

Jl  IMF’E 

PI.  PNIL 

if  P r NIL  then  PNIL  endif 

MOVE 

K.KEY (PJ ) 

CAMLE 

K.KEY(Ql) 

if  KEY(P)  < KEY  (0)  then 

JRST 

□SMALL 

PSMALL : 

IIRRZ 

Tl, RIGHT (PI) 

T - RIGHT (P); 

1 IRRM 

R, RIGHT (PI) 

RIGHT (P)  - R; 

nrivEi 

R.  (PI) 

R P; 

MMVEI 

PI,  (Tl) 

P - T 

? 

JRST 

DNLOOP 

e 1 se 

; 

COMMENT 

e?  see  QGMALL  « 

T RIGHT  CQ)  t 
RIGHT (Q)  R; 
R •-  Q: 

if 

Q - T 

end  i f 

> 

repeat : 
then 

\ 

PNIL: 

MOVE  I 

PI, (01) 

PNIL  ->  P - Q:  0 - LUST  (P) 

ONI  L : 

MOVE 

O.DIST (PI) 

0NIL  0 . 01  ST  (P) : 

(The  "rebalance"  phase  marches  up  the  path 
created  by  the  r i ghtmerge,  interchanging  the 
left  and  right  children  of  nodes  as  necessary 
to  guarantee  that  the  result  is  leftist.  At  the 
end,  PI  points  to  the  result. I 
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rinvr  i 

rusT.o 

niST(NIL)  = 0; 

. IRST 

1 II  'l  BOP 

1 oop  until  R ■=  NIL: 

NUSUITUItMUVE  I 

B.  1 (ED 

HtiF.TI 

PI  .RIGHT  (R > 

nOVEUP: 

I1IJV[  n 

ti.BIST  (R) 

nnvE  i 

Pi . (R) 

move  i 

H.  (Ql) 

UPLOOf’: 

ji  iriPE 

R.  IN) 

HRRZ 

Ql  .RIGHT (Rl 

Q »•  RIGHT (R);  IHere  Q is  the  next  higher  node 

HI  RZ 

TI.LEI  T(RI 

the  path,  P is  our  partial  result  and  is  left  is 

CAMG 

ti.BIST  (Tl) 

and  0 = DIST(P).  We  may  need  to  interchange  the 

JRST 

NCIRUI  TCH 

rh i 1 dr cn  of  R. 1 

SWITCH: 

Mi  IVF 

ri.nisT  ni) 

if  D > tl  I ST  (L  FFT  (R) ) then  IBo  the  i n ter  chancie . 

tirivLl 

D.l  (ED 

B - BIST  (LEFT  (R) ) -t  1; 

1 IRRM 

Tl  .RIGHT  (R) 

RIGHT (R)  - LEFT (R) ; 

HRI.M 

PI  .LFET(R) 

LEFT  (R)  - P 

JR  ST 

MQVELIP 

else  iNo  interchange  is  needed.) 

CfJMMLNT 

® see  NOSUITCH  » 

[1  . Di  1; 
RIGHT (R)  - P 

end i f : 

INow  complete  R and  move  up  the  path. 1 

COilMCNT 

® see  nOVEUP  ® 

DI  ST  (R)  FI; 

P . R; 

R - Cl 

repeat 

I'l  NIT 

Ml  il.  1 T 

end  II1RG_LTI; 

ni  gin 

I NS. IT 

1- 

0 

Q* 

procedure  INS..LT  (reference  (NODE  ) X; 

tINS_LT 

1 II IRZ 

Q,-l  (SAIL  P) 

reference(LT  QUEUE)  Q) ; 

ACISG 

SIZE (Q) 

SIZE (Q)  - SIZE (Q)  + 1; 

JUST 

INS  LIE L 

if  SIZE(Q)  < 0 then  ERROR  endif; 

Ml  IVF 

PI. ROOT (Q) 

1 IRRZ 

01, -2 (SAIL  P) 

iinvF  I 

1.1 

rinvEN 

T.BIST  (01)  ; D I ST (X)  - 1; 

st  tzm 

RIGHT (Ql ) ;LEFT  (X)  - RIGHT (X)  - NIL; 

JSP 

N.MRG  LT 

nnvEn 

PI . ROOT  (Q)  ; ROOT (Q)  - MRG  LT (ROOT (Q) , X) 

SUB 

SAIL  P.  (3. .31 

. IRST 

<?3  (SAIL  P) 

REND 

INS.LT  tend  I1NS_LTI; 

BEGIN 

DFLJ.T 

n- 

2 

reference(NODE)  procedure  DFL_LT 

TDEL.  L 1 

1 IRRZ 

0.-1 (SAIL  n 

(re  f erence  (L  T Ql  If  tlE  ) Q) 

SQSGF 

SIZF  (0) 

SIZE  (Q)  - SIZE  (CD  - 1; 

IRST 

[IT  L UFL 

if  SIZE(Ql  < 0 then  ERROR  endif; 

nnvE 

SAIL  R.ROOT(Q) 

L1EL_LT  - ROOT  (Q) ; 

HRRZ 

Ql. RIGHT  (SAIL  FT) 

III  RZ 

PI  .LEI  T (SAIL  R) 

JSP 

N.MRG  LT 

MlTVE  M 

Pl.ROHT(O)  ; ROOT (Q)  - MRG_LT (LEFT (ROOT (Q) ). RI GHT  (ROOT  (Cl) ) ) 

SI  IB 

SAIL  P.  12, .21 

jtc.t 

r-2(SAIL  P) 

Bt  NR 

BFLJJ  ; end  IDF.LJ.TI  ; 
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